Aug 16 09:02:07 user nova-compute[73208]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 09:02:10 user nova-compute[73208]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73208) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73208) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73208) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 09:02:10 user nova-compute[73208]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:02:10 user nova-compute[73208]: INFO nova.virt.driver [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 09:02:10 user nova-compute[73208]: INFO nova.compute.provider_config [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] Acquiring lock "singleton_lock" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] Acquired lock "singleton_lock" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] Releasing lock "singleton_lock" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] Full set of CONF: {{(pid=73208) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ******************************************************************************** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] Configuration options gathered from: {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ================================================================================ {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] allow_resize_to_same_host      = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] arq_binding_timeout            = 300 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] backdoor_port                  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] backdoor_socket                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] block_device_allocate_retries  = 300 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] block_device_allocate_retries_interval = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cert                           = self.pem {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute_monitors               = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] config_dir                     = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] config_drive_format            = iso9660 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] config_source                  = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] console_host                   = user {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] control_exchange               = nova {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cpu_allocation_ratio           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] daemon                         = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] debug                          = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] default_access_ip_network_name = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] default_availability_zone      = nova {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] default_ephemeral_format       = ext4 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] default_schedule_zone          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] disk_allocation_ratio          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] enable_new_services            = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] enabled_ssl_apis               = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] flat_injected                  = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] force_config_drive             = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] force_raw_images               = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] graceful_shutdown_timeout      = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] heal_instance_info_cache_interval = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] host                           = user {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] instance_build_timeout         = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] instance_delete_interval       = 300 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] instance_name_template         = instance-%08x {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] instance_usage_audit           = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] instance_usage_audit_period    = month {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] internal_service_availability_zone = internal {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] key                            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] live_migration_retry_count     = 30 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] log_config_append              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] log_dir                        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] log_file                       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] log_options                    = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] log_rotate_interval            = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] log_rotate_interval_type       = days {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] log_rotation_type              = none {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:10 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] long_rpc_timeout               = 1800 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] max_concurrent_builds          = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] max_concurrent_live_migrations = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] max_concurrent_snapshots       = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] max_local_block_devices        = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] max_logfile_count              = 30 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] max_logfile_size_mb            = 200 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] maximum_instance_delete_attempts = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] metadata_listen                = 0.0.0.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] metadata_listen_port           = 8775 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] metadata_workers               = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] migrate_max_retries            = -1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] mkisofs_cmd                    = genisoimage {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] my_ip                          = 10.0.0.210 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] network_allocate_retries       = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] osapi_compute_listen_port      = 8774 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] osapi_compute_unique_server_name_scope =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] osapi_compute_workers          = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] password_length                = 12 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] periodic_enable                = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] periodic_fuzzy_delay           = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] pointer_model                  = ps2mouse {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] preallocate_images             = none {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] publish_errors                 = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] pybasedir                      = /opt/stack/nova {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ram_allocation_ratio           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] rate_limit_burst               = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] rate_limit_except_level        = CRITICAL {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] rate_limit_interval            = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] reboot_timeout                 = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] reclaim_instance_interval      = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] record                         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] reimage_timeout_per_gb         = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] report_interval                = 120 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] rescue_timeout                 = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] reserved_host_cpus             = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] reserved_host_disk_mb          = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] reserved_host_memory_mb        = 512 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] reserved_huge_pages            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] resize_confirm_window          = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] resize_fs_using_block_device   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] resume_guests_state_on_host_boot = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] rpc_response_timeout           = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] run_external_periodic_tasks    = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] running_deleted_instance_action = reap {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] running_deleted_instance_timeout = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler_instance_sync_interval = 120 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_down_time              = 720 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] servicegroup_driver            = db {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] shelved_offload_time           = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] shelved_poll_interval          = 3600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] shutdown_timeout               = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] source_is_ipv6                 = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ssl_only                       = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] state_path                     = /opt/stack/data/nova {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] sync_power_state_interval      = 600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] sync_power_state_pool_size     = 1000 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] syslog_log_facility            = LOG_USER {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] tempdir                        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] timeout_nbd                    = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] transport_url                  = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] update_resources_interval      = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] use_cow_images                 = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] use_eventlog                   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] use_journal                    = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] use_json                       = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] use_rootwrap_daemon            = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] use_stderr                     = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] use_syslog                     = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vcpu_pin_set                   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plugging_is_fatal          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plugging_timeout           = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] virt_mkfs                      = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] volume_usage_poll_interval     = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] watch_log_file                 = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] web                            = /usr/share/spice-html5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.auth_strategy              = keystone {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.compute_link_prefix        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.dhcp_domain                = novalocal {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.enable_instance_password   = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.glance_link_prefix         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.instance_list_per_project_cells = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.list_records_by_skipping_down_cells = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.local_metadata_per_cell    = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.max_limit                  = 1000 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.metadata_cache_expiration  = 15 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.neutron_default_tenant_id  = default {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.use_forwarded_for          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.use_neutron_default_nets   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.vendordata_dynamic_targets = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.vendordata_jsonfile_path   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.backend_argument         = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.config_prefix            = cache.oslo {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.dead_timeout             = 60.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.debug_cache_backend      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.enable_retry_client      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.enable_socket_keepalive  = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.enabled                  = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.expiration_time          = 600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_dead_retry      = 300 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_password        =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_sasl_enabled    = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.memcache_username        =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.proxies                  = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.retry_attempts           = 2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.retry_delay              = 0.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.socket_keepalive_count   = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.socket_keepalive_idle    = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.socket_keepalive_interval = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.tls_allowed_ciphers      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.tls_cafile               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.tls_certfile             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.tls_enabled              = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cache.tls_keyfile              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.auth_section            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.auth_type               = password {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.cafile                  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.certfile                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.collect_timing          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.cross_az_attach         = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.debug                   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.endpoint_template       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.http_retries            = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.insecure                = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.keyfile                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.os_region_name          = RegionOne {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.split_loggers           = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cinder.timeout                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.cpu_dedicated_set      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.cpu_shared_set         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.image_type_exclude_list = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.resource_provider_association_refresh = 300 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.shutdown_retry_interval = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] conductor.workers              = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] console.allowed_origins        = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] console.ssl_ciphers            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] console.ssl_minimum_version    = default {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] consoleauth.token_ttl          = 600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.cafile                  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.certfile                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.collect_timing          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.connect_retries         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.connect_retry_delay     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.endpoint_override       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.insecure                = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.keyfile                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.max_version             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.min_version             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.region_name             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.service_name            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.service_type            = accelerator {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.split_loggers           = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.status_code_retries     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.status_code_retry_delay = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.timeout                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] cyborg.version                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.backend               = sqlalchemy {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.connection            = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.connection_debug      = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.connection_parameters =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.connection_recycle_time = 3600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.connection_trace      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.db_inc_retry_interval = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.db_max_retries        = 20 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.db_max_retry_interval = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.db_retry_interval     = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.max_overflow          = 50 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.max_pool_size         = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.max_retries           = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.mysql_enable_ndb      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.pool_timeout          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.retry_interval        = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.slave_connection      = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] database.sqlite_synchronous    = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.backend           = sqlalchemy {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.connection        = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.connection_debug  = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.connection_parameters =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.connection_recycle_time = 3600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.connection_trace  = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.db_inc_retry_interval = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.db_max_retries    = 20 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.db_max_retry_interval = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.db_retry_interval = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.max_overflow      = 50 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.max_pool_size     = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.max_retries       = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.mysql_enable_ndb  = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.pool_timeout      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.retry_interval    = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.slave_connection  = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] api_database.sqlite_synchronous = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] devices.enabled_mdev_types     = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ephemeral_storage_encryption.enabled = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.api_servers             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.cafile                  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.certfile                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.collect_timing          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.connect_retries         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.connect_retry_delay     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.debug                   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.default_trusted_certificate_ids = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.enable_certificate_validation = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.enable_rbd_download     = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.endpoint_override       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.insecure                = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.keyfile                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.max_version             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.min_version             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.num_retries             = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.rbd_ceph_conf           =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.rbd_connect_timeout     = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.rbd_pool                =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.rbd_user                =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.region_name             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.service_name            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.service_type            = image {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.split_loggers           = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.status_code_retries     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.status_code_retry_delay = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.timeout                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.verify_glance_signatures = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] glance.version                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] guestfs.debug                  = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.config_drive_cdrom      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.config_drive_inject_password = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.enable_remotefx         = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.instances_path_share    =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.limit_cpu_features      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.use_multipath_io        = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.vswitch_name            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] mks.enabled                    = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] image_cache.manager_interval   = 2400 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] image_cache.precache_concurrency = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] image_cache.remove_unused_base_images = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] image_cache.subdirectory_name  = _base {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.api_max_retries         = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.api_retry_interval      = 2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.auth_section            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.auth_type               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.cafile                  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.certfile                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.collect_timing          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.connect_retries         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.connect_retry_delay     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.endpoint_override       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.insecure                = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.keyfile                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.max_version             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.min_version             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.partition_key           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.peer_list               = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.region_name             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.serial_console_state_timeout = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.service_name            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.service_type            = baremetal {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.split_loggers           = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.status_code_retries     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.status_code_retry_delay = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.timeout                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ironic.version                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] key_manager.fixed_key          = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.barbican_api_version  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.barbican_endpoint     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.barbican_endpoint_type = public {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.barbican_region_name  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.cafile                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.certfile              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.collect_timing        = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.insecure              = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.keyfile               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.number_of_retries     = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.retry_delay           = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.send_service_user_token = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.split_loggers         = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.timeout               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.verify_ssl            = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican.verify_ssl_path       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.auth_section = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.auth_type = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.cafile   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.certfile = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.collect_timing = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.insecure = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.keyfile  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.split_loggers = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] barbican_service_user.timeout  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.approle_role_id          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.approle_secret_id        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.cafile                   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.certfile                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.collect_timing           = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.insecure                 = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.keyfile                  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.kv_mountpoint            = secret {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.kv_version               = 2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.namespace                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.root_token_id            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.split_loggers            = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.ssl_ca_crt_file          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.timeout                  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.use_ssl                  = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.cafile                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.certfile              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.collect_timing        = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.connect_retries       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.connect_retry_delay   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.endpoint_override     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.insecure              = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.keyfile               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.max_version           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.min_version           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.region_name           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.service_name          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.service_type          = identity {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.split_loggers         = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.status_code_retries   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.status_code_retry_delay = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.timeout               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] keystone.version               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.connection_uri         =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.cpu_mode               = custom {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: WARNING oslo_config.cfg [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.cpu_power_governor_high = performance {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.cpu_power_management   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.device_detach_attempts = 8 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.device_detach_timeout  = 20 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.disk_cachemodes        = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.disk_prefix            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.enabled_perf_events    = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.file_backed_memory     = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.gid_maps               = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.hw_disk_discard        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.hw_machine_type        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.images_rbd_pool        = rbd {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.images_type            = default {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.images_volume_group    = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.inject_key             = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.inject_partition       = -2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.inject_password        = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.iscsi_iface            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.iser_use_multipath     = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_downtime = 500 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_inbound_addr = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_scheme  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_timeout_action = abort {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_tunnelled = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: WARNING oslo_config.cfg [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 09:02:11 user nova-compute[73208]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 09:02:11 user nova-compute[73208]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 09:02:11 user nova-compute[73208]: and ``live_migration_inbound_addr`` respectively.
Aug 16 09:02:11 user nova-compute[73208]: ).  Its value may be silently ignored in the future.
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.live_migration_with_native_tls = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.max_queues             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.nfs_mount_options      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.num_pcie_ports         = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.pmem_namespaces        = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.quobyte_client_cfg     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rbd_secret_uuid        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rbd_user               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rescue_image_id        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rescue_kernel_id       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.rx_queue_size          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.smbfs_mount_options    =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.snapshot_compression   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.snapshot_image_format  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.sparse_logical_volumes = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.swtpm_enabled          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.swtpm_group            = tss {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.swtpm_user             = tss {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.sysinfo_serial         = unique {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.tb_cache_size          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.tx_queue_size          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.uid_maps               = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.use_virtio_for_bridges = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.virt_type              = kvm {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.volume_clear           = zero {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.volume_clear_size      = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.volume_use_multipath   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.vzstorage_cache_path   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.auth_section           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.auth_type              = password {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.cafile                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.certfile               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.collect_timing         = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.connect_retries        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.connect_retry_delay    = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.default_floating_pool  = public {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.endpoint_override      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.extension_sync_interval = 600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.http_retries           = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.insecure               = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.keyfile                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.max_version            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.min_version            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.ovs_bridge             = br-int {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.physnets               = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.region_name            = RegionOne {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.service_metadata_proxy = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.service_name           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.service_type           = network {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.split_loggers          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.status_code_retries    = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.status_code_retry_delay = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.timeout                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] neutron.version                = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] notifications.bdms_in_notifications = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] notifications.default_level    = INFO {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] notifications.notification_format = unversioned {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] notifications.notify_on_state_change = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] pci.alias                      = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] pci.device_spec                = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] pci.report_in_placement        = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.auth_section         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.auth_type            = password {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.cafile               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.certfile             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.collect_timing       = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.connect_retries      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.connect_retry_delay  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.default_domain_id    = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.default_domain_name  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.domain_id            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.domain_name          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.endpoint_override    = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.insecure             = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.keyfile              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.max_version          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.min_version          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.password             = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.project_domain_id    = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.project_domain_name  = Default {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.project_id           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.project_name         = service {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.region_name          = RegionOne {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.service_name         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.service_type         = placement {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.split_loggers        = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.status_code_retries  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.status_code_retry_delay = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.system_scope         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.timeout              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.trust_id             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.user_domain_id       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.user_domain_name     = Default {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.user_id              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.username             = placement {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] placement.version              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.cores                    = 20 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.count_usage_from_placement = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.injected_file_content_bytes = 10240 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.injected_file_path_length = 255 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.injected_files           = 5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.instances                = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.key_pairs                = 100 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.metadata_items           = 128 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.ram                      = 51200 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.recheck_quota            = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.server_group_members     = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] quota.server_groups            = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] rdp.enabled                    = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.image_metadata_prefilter = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.max_attempts         = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.max_placement_results = 1000 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] scheduler.workers              = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.host_subset_size = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.isolated_hosts = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.isolated_images = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.pci_in_placement = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.track_instance_changes = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] metrics.required               = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] metrics.weight_multiplier      = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] metrics.weight_setting         = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] serial_console.enabled         = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] serial_console.port_range      = 10000:20000 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] serial_console.serialproxy_port = 6083 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.auth_section      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.auth_type         = password {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.cafile            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.certfile          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.collect_timing    = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.insecure          = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.keyfile           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.send_service_user_token = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.split_loggers     = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] service_user.timeout           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.agent_enabled            = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.enabled                  = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.html5proxy_port          = 6082 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.image_compression        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.jpeg_compression         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.playback_compression     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.server_listen            = 127.0.0.1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.streaming_mode           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] spice.zlib_compression         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] upgrade_levels.baseapi         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] upgrade_levels.cert            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] upgrade_levels.compute         = auto {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] upgrade_levels.conductor       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] upgrade_levels.scheduler       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.cafile = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.certfile = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.insecure = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vendordata_dynamic_auth.timeout = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.api_retry_count         = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.ca_file                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.cache_prefix            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.cluster_name            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.connection_pool_size    = 10 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.console_delay_seconds   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.datastore_regex         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.host_ip                 = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.host_password           = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.host_port               = 443 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.host_username           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.insecure                = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.integration_bridge      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.maximum_objects         = 100 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.pbm_default_policy      = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.pbm_enabled             = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.pbm_wsdl_location       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.serial_port_proxy_uri   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.serial_port_service_uri = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.task_poll_interval      = 0.5 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.use_linked_clone        = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.vnc_keymap              = en-us {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.vnc_port                = 5900 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vmware.vnc_port_total          = 10000 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.auth_schemes               = ['none'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.enabled                    = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.novncproxy_port            = 6080 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.vencrypt_ca_certs          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.vencrypt_client_cert       = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vnc.vencrypt_client_key        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.disable_rootwrap   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.enable_numa_live_migration = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.libvirt_disable_apic = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.client_socket_timeout     = 900 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.default_pool_size         = 1000 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.keep_alive                = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.max_header_line           = 16384 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.ssl_ca_file               = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.ssl_cert_file             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.ssl_key_file              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.tcp_keepidle              = 600 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] zvm.ca_file                    = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] zvm.cloud_connector_url        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] zvm.reachable_timeout          = 300 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.enforce_new_defaults = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.enforce_scope      = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.policy_default_rule = default {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.connection_string     = messaging:// {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.enabled               = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.es_doc_type           = notification {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.es_scroll_size        = 10000 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.es_scroll_time        = 2m {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.filter_error_trace    = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.hmac_keys             = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.sentinel_service_name = mymaster {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.socket_timeout        = 0.1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.trace_requests        = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler.trace_sqlalchemy      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler_jaeger.process_tags   = {} {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] profiler_otlp.service_name_prefix = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] remote_debug.host              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] remote_debug.port              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.auth_section        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.auth_type           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.cafile              = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.certfile            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.collect_timing      = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.connect_retries     = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.connect_retry_delay = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.endpoint_id         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.endpoint_override   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.insecure            = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.keyfile             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.max_version         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.min_version         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.region_name         = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.service_name        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.service_type        = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.split_loggers       = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.status_code_retries = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.status_code_retry_delay = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.timeout             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.valid_interfaces    = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_limit.version             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_reports.file_event_handler = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] oslo_reports.log_dir           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_ovs_privileged.group  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] vif_plug_ovs_privileged.user   = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_ovs.isolate_vif         = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] os_brick.lock_path             = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] privsep_osbrick.capabilities   = [21] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] privsep_osbrick.group          = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] privsep_osbrick.helper_command = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] privsep_osbrick.user           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] nova_sys_admin.group           = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] nova_sys_admin.helper_command  = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] nova_sys_admin.user            = None {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG oslo_service.service [None req-7f2448dd-4d9b-4471-9b1a-7e2ec85730b0 None None] ******************************************************************************** {{(pid=73208) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 09:02:11 user nova-compute[73208]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 09:02:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Starting native event thread {{(pid=73208) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Starting green dispatch thread {{(pid=73208) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Starting connection event dispatch thread {{(pid=73208) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Connecting to libvirt: qemu:///system {{(pid=73208) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff6f4244f10> {{(pid=73208) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 09:02:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff6f4244f10> {{(pid=73208) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 09:02:11 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Connection event '1' reason 'None'
Aug 16 09:02:11 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 09:02:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.mount [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Initialising _HostMountState generation 0 {{(pid=73208) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 09:02:18 user nova-compute[73208]: INFO nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host capabilities <capabilities>
Aug 16 09:02:18 user nova-compute[73208]:   <host>
Aug 16 09:02:18 user nova-compute[73208]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 09:02:18 user nova-compute[73208]:     <cpu>
Aug 16 09:02:18 user nova-compute[73208]:       <arch>x86_64</arch>
Aug 16 09:02:18 user nova-compute[73208]:       <model>IvyBridge-IBRS</model>
Aug 16 09:02:18 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:18 user nova-compute[73208]:       <microcode version='1070'/>
Aug 16 09:02:18 user nova-compute[73208]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 09:02:18 user nova-compute[73208]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='ss'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='vmx'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='pcid'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='osxsave'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='hypervisor'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='arat'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='tsc_adjust'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='md-clear'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='stibp'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='arch-capabilities'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='ssbd'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='invtsc'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='rsba'/>
Aug 16 09:02:18 user nova-compute[73208]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 09:02:18 user nova-compute[73208]:       <pages unit='KiB' size='4'/>
Aug 16 09:02:18 user nova-compute[73208]:       <pages unit='KiB' size='2048'/>
Aug 16 09:02:18 user nova-compute[73208]:     </cpu>
Aug 16 09:02:18 user nova-compute[73208]:     <power_management>
Aug 16 09:02:18 user nova-compute[73208]:       <suspend_mem/>
Aug 16 09:02:18 user nova-compute[73208]:       <suspend_disk/>
Aug 16 09:02:18 user nova-compute[73208]:       <suspend_hybrid/>
Aug 16 09:02:18 user nova-compute[73208]:     </power_management>
Aug 16 09:02:18 user nova-compute[73208]:     <iommu support='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     <migration_features>
Aug 16 09:02:18 user nova-compute[73208]:       <live/>
Aug 16 09:02:18 user nova-compute[73208]:       <uri_transports>
Aug 16 09:02:18 user nova-compute[73208]:         <uri_transport>tcp</uri_transport>
Aug 16 09:02:18 user nova-compute[73208]:         <uri_transport>rdma</uri_transport>
Aug 16 09:02:18 user nova-compute[73208]:       </uri_transports>
Aug 16 09:02:18 user nova-compute[73208]:     </migration_features>
Aug 16 09:02:18 user nova-compute[73208]:     <topology>
Aug 16 09:02:18 user nova-compute[73208]:       <cells num='2'>
Aug 16 09:02:18 user nova-compute[73208]:         <cell id='0'>
Aug 16 09:02:18 user nova-compute[73208]:           <memory unit='KiB'>8140616</memory>
Aug 16 09:02:18 user nova-compute[73208]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 16 09:02:18 user nova-compute[73208]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 09:02:18 user nova-compute[73208]:           <distances>
Aug 16 09:02:18 user nova-compute[73208]:             <sibling id='0' value='10'/>
Aug 16 09:02:18 user nova-compute[73208]:             <sibling id='1' value='20'/>
Aug 16 09:02:18 user nova-compute[73208]:           </distances>
Aug 16 09:02:18 user nova-compute[73208]:           <cpus num='6'>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 09:02:18 user nova-compute[73208]:           </cpus>
Aug 16 09:02:18 user nova-compute[73208]:         </cell>
Aug 16 09:02:18 user nova-compute[73208]:         <cell id='1'>
Aug 16 09:02:18 user nova-compute[73208]:           <memory unit='KiB'>8255100</memory>
Aug 16 09:02:18 user nova-compute[73208]:           <pages unit='KiB' size='4'>2063775</pages>
Aug 16 09:02:18 user nova-compute[73208]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 09:02:18 user nova-compute[73208]:           <distances>
Aug 16 09:02:18 user nova-compute[73208]:             <sibling id='0' value='20'/>
Aug 16 09:02:18 user nova-compute[73208]:             <sibling id='1' value='10'/>
Aug 16 09:02:18 user nova-compute[73208]:           </distances>
Aug 16 09:02:18 user nova-compute[73208]:           <cpus num='6'>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 09:02:18 user nova-compute[73208]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 09:02:18 user nova-compute[73208]:           </cpus>
Aug 16 09:02:18 user nova-compute[73208]:         </cell>
Aug 16 09:02:18 user nova-compute[73208]:       </cells>
Aug 16 09:02:18 user nova-compute[73208]:     </topology>
Aug 16 09:02:18 user nova-compute[73208]:     <cache>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 09:02:18 user nova-compute[73208]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 09:02:18 user nova-compute[73208]:     </cache>
Aug 16 09:02:18 user nova-compute[73208]:     <secmodel>
Aug 16 09:02:18 user nova-compute[73208]:       <model>apparmor</model>
Aug 16 09:02:18 user nova-compute[73208]:       <doi>0</doi>
Aug 16 09:02:18 user nova-compute[73208]:     </secmodel>
Aug 16 09:02:18 user nova-compute[73208]:     <secmodel>
Aug 16 09:02:18 user nova-compute[73208]:       <model>dac</model>
Aug 16 09:02:18 user nova-compute[73208]:       <doi>0</doi>
Aug 16 09:02:18 user nova-compute[73208]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 09:02:18 user nova-compute[73208]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 09:02:18 user nova-compute[73208]:     </secmodel>
Aug 16 09:02:18 user nova-compute[73208]:   </host>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='alpha'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>clipper</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='armv6l'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>spitz</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>nuri</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>kzm</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sx1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>z2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>tosa</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>n810</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>n800</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>terrier</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>midway</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>microbit</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>verdex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>highbank</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>akita</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>connex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>collie</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='armv7l'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>spitz</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>nuri</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>kzm</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sx1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>z2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>tosa</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>n810</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>n800</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>terrier</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>midway</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>microbit</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>verdex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>highbank</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>akita</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>connex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>collie</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='aarch64'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>spitz</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>nuri</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>kzm</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sx1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>z2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>tosa</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>n810</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>n800</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>terrier</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>midway</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>microbit</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>verdex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>highbank</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>akita</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>connex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>collie</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <acpi default='on' toggle='yes'/>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='cris'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='i686'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>isapc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>microvm</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='kvm'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <pae/>
Aug 16 09:02:18 user nova-compute[73208]:       <nonpae/>
Aug 16 09:02:18 user nova-compute[73208]:       <acpi default='on' toggle='yes'/>
Aug 16 09:02:18 user nova-compute[73208]:       <apic default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='m68k'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>an5206</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>q800</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='microblaze'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='microblazeel'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='mips'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='16'>malta</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='mipsel'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='16'>malta</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='mips64'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='16'>malta</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>pica61</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>magnum</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='mips64el'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='16'>malta</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>pica61</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>magnum</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='16'>boston</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='ppc'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mac99</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>40p</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>taihu</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='ppc64'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>taihu</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>40p</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mac99</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='ppc64le'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>taihu</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>40p</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>mac99</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='riscv32'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='8'>spike</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='8'>virt</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='riscv64'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='8'>spike</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='8'>virt</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='s390x'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='sh4'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>shix</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>r2d</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='sh4eb'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>shix</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>r2d</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='sparc'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>LX</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='sparc64'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>niagara</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:18 user nova-compute[73208]:     </arch>
Aug 16 09:02:18 user nova-compute[73208]:     <features>
Aug 16 09:02:18 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:18 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:18 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:18 user nova-compute[73208]:     </features>
Aug 16 09:02:18 user nova-compute[73208]:   </guest>
Aug 16 09:02:18 user nova-compute[73208]:   <guest>
Aug 16 09:02:18 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:18 user nova-compute[73208]:     <arch name='x86_64'>
Aug 16 09:02:18 user nova-compute[73208]:       <wordsize>64</wordsize>
Aug 16 09:02:18 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='1'>isapc</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 09:02:18 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>microvm</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:19 user nova-compute[73208]:       <domain type='kvm'/>
Aug 16 09:02:19 user nova-compute[73208]:     </arch>
Aug 16 09:02:19 user nova-compute[73208]:     <features>
Aug 16 09:02:19 user nova-compute[73208]:       <acpi default='on' toggle='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:       <apic default='on' toggle='no'/>
Aug 16 09:02:19 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:19 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:19 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     </features>
Aug 16 09:02:19 user nova-compute[73208]:   </guest>
Aug 16 09:02:19 user nova-compute[73208]:   <guest>
Aug 16 09:02:19 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:19 user nova-compute[73208]:     <arch name='xtensa'>
Aug 16 09:02:19 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:19 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='4'>sim</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>kc705</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>ml605</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>virt</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>lx200</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>lx60</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:19 user nova-compute[73208]:     </arch>
Aug 16 09:02:19 user nova-compute[73208]:     <features>
Aug 16 09:02:19 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:19 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:19 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     </features>
Aug 16 09:02:19 user nova-compute[73208]:   </guest>
Aug 16 09:02:19 user nova-compute[73208]:   <guest>
Aug 16 09:02:19 user nova-compute[73208]:     <os_type>hvm</os_type>
Aug 16 09:02:19 user nova-compute[73208]:     <arch name='xtensaeb'>
Aug 16 09:02:19 user nova-compute[73208]:       <wordsize>32</wordsize>
Aug 16 09:02:19 user nova-compute[73208]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='4'>sim</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>kc705</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>ml605</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>virt</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>lx200</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>lx60</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 09:02:19 user nova-compute[73208]:       <domain type='qemu'/>
Aug 16 09:02:19 user nova-compute[73208]:     </arch>
Aug 16 09:02:19 user nova-compute[73208]:     <features>
Aug 16 09:02:19 user nova-compute[73208]:       <cpuselection/>
Aug 16 09:02:19 user nova-compute[73208]:       <deviceboot/>
Aug 16 09:02:19 user nova-compute[73208]:       <disksnapshot default='on' toggle='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     </features>
Aug 16 09:02:19 user nova-compute[73208]:   </guest>
Aug 16 09:02:19 user nova-compute[73208]: </capabilities>
Aug 16 09:02:19 user nova-compute[73208]: 
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 09:02:19 user nova-compute[73208]: <domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 09:02:19 user nova-compute[73208]:   <domain>kvm</domain>
Aug 16 09:02:19 user nova-compute[73208]:   <machine>pc-q35-jammy</machine>
Aug 16 09:02:19 user nova-compute[73208]:   <arch>i686</arch>
Aug 16 09:02:19 user nova-compute[73208]:   <vcpu max='288'/>
Aug 16 09:02:19 user nova-compute[73208]:   <iothreads supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:   <os supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='firmware'/>
Aug 16 09:02:19 user nova-compute[73208]:     <loader supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>rom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pflash</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='readonly'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='secure'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </loader>
Aug 16 09:02:19 user nova-compute[73208]:   </os>
Aug 16 09:02:19 user nova-compute[73208]:   <cpu>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-passthrough' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='hostPassthroughMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='maximum' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='maximumMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-model' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ss'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='vmx'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pcid'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='hypervisor'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arat'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='umip'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='md-clear'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibpb'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibrs'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='erms'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='lm'/>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='custom' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>qemu64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>qemu32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>phenom</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>n270</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>kvm64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>coreduo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>core2duo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>athlon</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Westmere</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Snowridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Penryn</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G5</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G4</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G1</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Rome</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Milan</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Dhyana</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cooperlake</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Conroe</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>486</model>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:   </cpu>
Aug 16 09:02:19 user nova-compute[73208]:   <memoryBacking supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='sourceType'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>file</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>anonymous</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>memfd</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:   </memoryBacking>
Aug 16 09:02:19 user nova-compute[73208]:   <devices>
Aug 16 09:02:19 user nova-compute[73208]:     <disk supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='diskDevice'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>disk</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cdrom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>floppy</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>lun</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='bus'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>fdc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sata</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </disk>
Aug 16 09:02:19 user nova-compute[73208]:     <graphics supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sdl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vnc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>spice</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egl-headless</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </graphics>
Aug 16 09:02:19 user nova-compute[73208]:     <video supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='modelType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cirrus</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vmvga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>qxl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>none</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>bochs</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ramfb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </video>
Aug 16 09:02:19 user nova-compute[73208]:     <hostdev supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='mode'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>subsystem</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='startupPolicy'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>default</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>mandatory</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>requisite</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>optional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='subsysType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pci</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='capsType'/>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='pciBackend'/>
Aug 16 09:02:19 user nova-compute[73208]:     </hostdev>
Aug 16 09:02:19 user nova-compute[73208]:     <rng supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>random</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egd</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>builtin</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </rng>
Aug 16 09:02:19 user nova-compute[73208]:     <filesystem supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='driverType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>path</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>handle</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtiofs</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </filesystem>
Aug 16 09:02:19 user nova-compute[73208]:     <tpm supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-tis</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-crb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>passthrough</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>emulator</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </tpm>
Aug 16 09:02:19 user nova-compute[73208]:   </devices>
Aug 16 09:02:19 user nova-compute[73208]:   <features>
Aug 16 09:02:19 user nova-compute[73208]:     <gic supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     <vmcoreinfo supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <genid supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backingStoreInput supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backup supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <sev supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:   </features>
Aug 16 09:02:19 user nova-compute[73208]: </domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 09:02:19 user nova-compute[73208]: <domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 09:02:19 user nova-compute[73208]:   <domain>kvm</domain>
Aug 16 09:02:19 user nova-compute[73208]:   <machine>pc-i440fx-jammy</machine>
Aug 16 09:02:19 user nova-compute[73208]:   <arch>i686</arch>
Aug 16 09:02:19 user nova-compute[73208]:   <vcpu max='255'/>
Aug 16 09:02:19 user nova-compute[73208]:   <iothreads supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:   <os supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='firmware'/>
Aug 16 09:02:19 user nova-compute[73208]:     <loader supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>rom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pflash</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='readonly'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='secure'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </loader>
Aug 16 09:02:19 user nova-compute[73208]:   </os>
Aug 16 09:02:19 user nova-compute[73208]:   <cpu>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-passthrough' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='hostPassthroughMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='maximum' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='maximumMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-model' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ss'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='vmx'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pcid'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='hypervisor'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arat'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='umip'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='md-clear'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibpb'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibrs'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='erms'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='lm'/>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='custom' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>qemu64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>qemu32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>phenom</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>n270</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>kvm64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>coreduo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>core2duo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>athlon</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Westmere</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Snowridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Penryn</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G5</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G4</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G1</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Rome</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Milan</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Dhyana</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cooperlake</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Conroe</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>486</model>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:   </cpu>
Aug 16 09:02:19 user nova-compute[73208]:   <memoryBacking supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='sourceType'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>file</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>anonymous</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>memfd</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:   </memoryBacking>
Aug 16 09:02:19 user nova-compute[73208]:   <devices>
Aug 16 09:02:19 user nova-compute[73208]:     <disk supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='diskDevice'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>disk</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cdrom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>floppy</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>lun</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='bus'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ide</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>fdc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sata</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </disk>
Aug 16 09:02:19 user nova-compute[73208]:     <graphics supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sdl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vnc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>spice</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egl-headless</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </graphics>
Aug 16 09:02:19 user nova-compute[73208]:     <video supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='modelType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cirrus</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vmvga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>qxl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>none</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>bochs</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ramfb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </video>
Aug 16 09:02:19 user nova-compute[73208]:     <hostdev supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='mode'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>subsystem</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='startupPolicy'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>default</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>mandatory</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>requisite</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>optional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='subsysType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pci</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='capsType'/>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='pciBackend'/>
Aug 16 09:02:19 user nova-compute[73208]:     </hostdev>
Aug 16 09:02:19 user nova-compute[73208]:     <rng supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>random</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egd</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>builtin</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </rng>
Aug 16 09:02:19 user nova-compute[73208]:     <filesystem supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='driverType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>path</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>handle</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtiofs</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </filesystem>
Aug 16 09:02:19 user nova-compute[73208]:     <tpm supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-tis</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-crb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>passthrough</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>emulator</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </tpm>
Aug 16 09:02:19 user nova-compute[73208]:   </devices>
Aug 16 09:02:19 user nova-compute[73208]:   <features>
Aug 16 09:02:19 user nova-compute[73208]:     <gic supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     <vmcoreinfo supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <genid supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backingStoreInput supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backup supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <sev supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:   </features>
Aug 16 09:02:19 user nova-compute[73208]: </domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 09:02:19 user nova-compute[73208]: <domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 09:02:19 user nova-compute[73208]:   <domain>kvm</domain>
Aug 16 09:02:19 user nova-compute[73208]:   <machine>pc-q35-6.2</machine>
Aug 16 09:02:19 user nova-compute[73208]:   <arch>i686</arch>
Aug 16 09:02:19 user nova-compute[73208]:   <vcpu max='288'/>
Aug 16 09:02:19 user nova-compute[73208]:   <iothreads supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:   <os supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='firmware'/>
Aug 16 09:02:19 user nova-compute[73208]:     <loader supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>rom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pflash</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='readonly'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='secure'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </loader>
Aug 16 09:02:19 user nova-compute[73208]:   </os>
Aug 16 09:02:19 user nova-compute[73208]:   <cpu>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-passthrough' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='hostPassthroughMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='maximum' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='maximumMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-model' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ss'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='vmx'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pcid'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='hypervisor'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arat'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='umip'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='md-clear'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibpb'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibrs'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='erms'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='lm'/>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='custom' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>qemu64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>qemu32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>phenom</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>n270</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>kvm64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>coreduo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>core2duo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>athlon</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Westmere</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Snowridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Penryn</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G5</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G4</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G1</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Rome</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Milan</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Dhyana</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cooperlake</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Conroe</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>486</model>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:   </cpu>
Aug 16 09:02:19 user nova-compute[73208]:   <memoryBacking supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='sourceType'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>file</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>anonymous</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>memfd</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:   </memoryBacking>
Aug 16 09:02:19 user nova-compute[73208]:   <devices>
Aug 16 09:02:19 user nova-compute[73208]:     <disk supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='diskDevice'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>disk</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cdrom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>floppy</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>lun</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='bus'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>fdc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sata</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </disk>
Aug 16 09:02:19 user nova-compute[73208]:     <graphics supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sdl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vnc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>spice</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egl-headless</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </graphics>
Aug 16 09:02:19 user nova-compute[73208]:     <video supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='modelType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cirrus</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vmvga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>qxl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>none</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>bochs</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ramfb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </video>
Aug 16 09:02:19 user nova-compute[73208]:     <hostdev supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='mode'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>subsystem</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='startupPolicy'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>default</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>mandatory</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>requisite</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>optional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='subsysType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pci</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='capsType'/>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='pciBackend'/>
Aug 16 09:02:19 user nova-compute[73208]:     </hostdev>
Aug 16 09:02:19 user nova-compute[73208]:     <rng supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>random</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egd</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>builtin</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </rng>
Aug 16 09:02:19 user nova-compute[73208]:     <filesystem supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='driverType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>path</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>handle</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtiofs</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </filesystem>
Aug 16 09:02:19 user nova-compute[73208]:     <tpm supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-tis</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-crb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>passthrough</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>emulator</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </tpm>
Aug 16 09:02:19 user nova-compute[73208]:   </devices>
Aug 16 09:02:19 user nova-compute[73208]:   <features>
Aug 16 09:02:19 user nova-compute[73208]:     <gic supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     <vmcoreinfo supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <genid supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backingStoreInput supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backup supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <sev supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:   </features>
Aug 16 09:02:19 user nova-compute[73208]: </domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 09:02:19 user nova-compute[73208]: <domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 09:02:19 user nova-compute[73208]:   <domain>kvm</domain>
Aug 16 09:02:19 user nova-compute[73208]:   <machine>pc-i440fx-6.2</machine>
Aug 16 09:02:19 user nova-compute[73208]:   <arch>i686</arch>
Aug 16 09:02:19 user nova-compute[73208]:   <vcpu max='255'/>
Aug 16 09:02:19 user nova-compute[73208]:   <iothreads supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:   <os supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='firmware'/>
Aug 16 09:02:19 user nova-compute[73208]:     <loader supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>rom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pflash</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='readonly'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='secure'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </loader>
Aug 16 09:02:19 user nova-compute[73208]:   </os>
Aug 16 09:02:19 user nova-compute[73208]:   <cpu>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-passthrough' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='hostPassthroughMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='maximum' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='maximumMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-model' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ss'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='vmx'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pcid'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='hypervisor'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arat'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='umip'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='md-clear'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibpb'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibrs'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='erms'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='lm'/>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='custom' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>qemu64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>qemu32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>phenom</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>n270</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>kvm64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>coreduo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>core2duo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>athlon</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Westmere</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Snowridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Penryn</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G5</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G4</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G1</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Rome</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Milan</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Dhyana</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cooperlake</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Conroe</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>486</model>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:   </cpu>
Aug 16 09:02:19 user nova-compute[73208]:   <memoryBacking supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='sourceType'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>file</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>anonymous</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>memfd</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:   </memoryBacking>
Aug 16 09:02:19 user nova-compute[73208]:   <devices>
Aug 16 09:02:19 user nova-compute[73208]:     <disk supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='diskDevice'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>disk</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cdrom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>floppy</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>lun</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='bus'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ide</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>fdc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sata</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </disk>
Aug 16 09:02:19 user nova-compute[73208]:     <graphics supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sdl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vnc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>spice</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egl-headless</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </graphics>
Aug 16 09:02:19 user nova-compute[73208]:     <video supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='modelType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cirrus</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vmvga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>qxl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>none</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>bochs</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ramfb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </video>
Aug 16 09:02:19 user nova-compute[73208]:     <hostdev supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='mode'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>subsystem</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='startupPolicy'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>default</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>mandatory</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>requisite</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>optional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='subsysType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pci</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='capsType'/>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='pciBackend'/>
Aug 16 09:02:19 user nova-compute[73208]:     </hostdev>
Aug 16 09:02:19 user nova-compute[73208]:     <rng supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>random</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egd</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>builtin</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </rng>
Aug 16 09:02:19 user nova-compute[73208]:     <filesystem supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='driverType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>path</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>handle</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtiofs</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </filesystem>
Aug 16 09:02:19 user nova-compute[73208]:     <tpm supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-tis</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-crb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>passthrough</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>emulator</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </tpm>
Aug 16 09:02:19 user nova-compute[73208]:   </devices>
Aug 16 09:02:19 user nova-compute[73208]:   <features>
Aug 16 09:02:19 user nova-compute[73208]:     <gic supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     <vmcoreinfo supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <genid supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backingStoreInput supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backup supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <sev supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:   </features>
Aug 16 09:02:19 user nova-compute[73208]: </domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 09:02:19 user nova-compute[73208]: <domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 09:02:19 user nova-compute[73208]:   <domain>kvm</domain>
Aug 16 09:02:19 user nova-compute[73208]:   <machine>pc-q35-jammy</machine>
Aug 16 09:02:19 user nova-compute[73208]:   <arch>x86_64</arch>
Aug 16 09:02:19 user nova-compute[73208]:   <vcpu max='288'/>
Aug 16 09:02:19 user nova-compute[73208]:   <iothreads supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:   <os supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='firmware'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>efi</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:     <loader supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>rom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pflash</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='readonly'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='secure'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </loader>
Aug 16 09:02:19 user nova-compute[73208]:   </os>
Aug 16 09:02:19 user nova-compute[73208]:   <cpu>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-passthrough' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='hostPassthroughMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='maximum' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='maximumMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-model' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ss'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='vmx'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pcid'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='hypervisor'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arat'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='umip'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='md-clear'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='invtsc'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibpb'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibrs'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='rsba'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='erms'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='custom' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>qemu64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>qemu32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>phenom</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>n270</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>coreduo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>core2duo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>athlon</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Westmere</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Snowridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Penryn</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G5</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G4</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Opteron_G1</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Rome</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Milan</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Dhyana</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cooperlake</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Conroe</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>486</model>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:   </cpu>
Aug 16 09:02:19 user nova-compute[73208]:   <memoryBacking supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='sourceType'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>file</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>anonymous</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>memfd</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:   </memoryBacking>
Aug 16 09:02:19 user nova-compute[73208]:   <devices>
Aug 16 09:02:19 user nova-compute[73208]:     <disk supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='diskDevice'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>disk</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cdrom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>floppy</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>lun</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='bus'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>fdc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sata</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </disk>
Aug 16 09:02:19 user nova-compute[73208]:     <graphics supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sdl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vnc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>spice</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egl-headless</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </graphics>
Aug 16 09:02:19 user nova-compute[73208]:     <video supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='modelType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cirrus</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vmvga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>qxl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>none</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>bochs</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ramfb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </video>
Aug 16 09:02:19 user nova-compute[73208]:     <hostdev supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='mode'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>subsystem</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='startupPolicy'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>default</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>mandatory</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>requisite</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>optional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='subsysType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pci</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='capsType'/>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='pciBackend'/>
Aug 16 09:02:19 user nova-compute[73208]:     </hostdev>
Aug 16 09:02:19 user nova-compute[73208]:     <rng supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>random</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egd</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>builtin</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </rng>
Aug 16 09:02:19 user nova-compute[73208]:     <filesystem supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='driverType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>path</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>handle</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtiofs</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </filesystem>
Aug 16 09:02:19 user nova-compute[73208]:     <tpm supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-tis</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-crb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>passthrough</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>emulator</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </tpm>
Aug 16 09:02:19 user nova-compute[73208]:   </devices>
Aug 16 09:02:19 user nova-compute[73208]:   <features>
Aug 16 09:02:19 user nova-compute[73208]:     <gic supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     <vmcoreinfo supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <genid supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backingStoreInput supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backup supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <sev supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:   </features>
Aug 16 09:02:19 user nova-compute[73208]: </domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 09:02:19 user nova-compute[73208]: <domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 09:02:19 user nova-compute[73208]:   <domain>kvm</domain>
Aug 16 09:02:19 user nova-compute[73208]:   <machine>pc-i440fx-jammy</machine>
Aug 16 09:02:19 user nova-compute[73208]:   <arch>x86_64</arch>
Aug 16 09:02:19 user nova-compute[73208]:   <vcpu max='255'/>
Aug 16 09:02:19 user nova-compute[73208]:   <iothreads supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:   <os supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='firmware'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>efi</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:     <loader supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>rom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pflash</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='readonly'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='secure'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </loader>
Aug 16 09:02:19 user nova-compute[73208]:   </os>
Aug 16 09:02:19 user nova-compute[73208]:   <cpu>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-passthrough' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='hostPassthroughMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='maximum' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='maximumMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-model' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ss'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='vmx'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pcid'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='hypervisor'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arat'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='umip'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='md-clear'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='invtsc'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibpb'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibrs'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='rsba'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='erms'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='custom' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>qemu64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>qemu32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>phenom</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>n270</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>coreduo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>core2duo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>athlon</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Westmere</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Snowridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Penryn</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G5</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G4</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Opteron_G1</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Rome</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Milan</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Dhyana</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cooperlake</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Conroe</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>486</model>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:   </cpu>
Aug 16 09:02:19 user nova-compute[73208]:   <memoryBacking supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='sourceType'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>file</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>anonymous</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>memfd</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:   </memoryBacking>
Aug 16 09:02:19 user nova-compute[73208]:   <devices>
Aug 16 09:02:19 user nova-compute[73208]:     <disk supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='diskDevice'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>disk</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cdrom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>floppy</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>lun</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='bus'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ide</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>fdc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sata</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </disk>
Aug 16 09:02:19 user nova-compute[73208]:     <graphics supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sdl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vnc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>spice</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egl-headless</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </graphics>
Aug 16 09:02:19 user nova-compute[73208]:     <video supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='modelType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cirrus</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vmvga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>qxl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>none</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>bochs</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ramfb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </video>
Aug 16 09:02:19 user nova-compute[73208]:     <hostdev supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='mode'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>subsystem</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='startupPolicy'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>default</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>mandatory</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>requisite</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>optional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='subsysType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pci</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='capsType'/>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='pciBackend'/>
Aug 16 09:02:19 user nova-compute[73208]:     </hostdev>
Aug 16 09:02:19 user nova-compute[73208]:     <rng supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>random</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egd</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>builtin</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </rng>
Aug 16 09:02:19 user nova-compute[73208]:     <filesystem supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='driverType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>path</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>handle</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtiofs</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </filesystem>
Aug 16 09:02:19 user nova-compute[73208]:     <tpm supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-tis</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-crb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>passthrough</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>emulator</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </tpm>
Aug 16 09:02:19 user nova-compute[73208]:   </devices>
Aug 16 09:02:19 user nova-compute[73208]:   <features>
Aug 16 09:02:19 user nova-compute[73208]:     <gic supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     <vmcoreinfo supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <genid supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backingStoreInput supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backup supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <sev supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:   </features>
Aug 16 09:02:19 user nova-compute[73208]: </domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 09:02:19 user nova-compute[73208]: <domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 09:02:19 user nova-compute[73208]:   <domain>kvm</domain>
Aug 16 09:02:19 user nova-compute[73208]:   <machine>pc-q35-6.2</machine>
Aug 16 09:02:19 user nova-compute[73208]:   <arch>x86_64</arch>
Aug 16 09:02:19 user nova-compute[73208]:   <vcpu max='288'/>
Aug 16 09:02:19 user nova-compute[73208]:   <iothreads supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:   <os supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='firmware'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>efi</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:     <loader supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>rom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pflash</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='readonly'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='secure'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </loader>
Aug 16 09:02:19 user nova-compute[73208]:   </os>
Aug 16 09:02:19 user nova-compute[73208]:   <cpu>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-passthrough' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='hostPassthroughMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='maximum' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='maximumMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-model' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ss'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='vmx'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pcid'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='hypervisor'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arat'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='umip'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='md-clear'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='invtsc'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibpb'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibrs'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='rsba'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='erms'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='custom' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>qemu64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>qemu32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>phenom</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>n270</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>coreduo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>core2duo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>athlon</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Westmere</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Snowridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Penryn</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G5</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G4</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Opteron_G1</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Rome</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Milan</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Dhyana</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cooperlake</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Conroe</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>486</model>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:   </cpu>
Aug 16 09:02:19 user nova-compute[73208]:   <memoryBacking supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='sourceType'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>file</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>anonymous</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>memfd</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:   </memoryBacking>
Aug 16 09:02:19 user nova-compute[73208]:   <devices>
Aug 16 09:02:19 user nova-compute[73208]:     <disk supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='diskDevice'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>disk</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cdrom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>floppy</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>lun</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='bus'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>fdc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sata</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </disk>
Aug 16 09:02:19 user nova-compute[73208]:     <graphics supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sdl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vnc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>spice</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egl-headless</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </graphics>
Aug 16 09:02:19 user nova-compute[73208]:     <video supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='modelType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cirrus</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vmvga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>qxl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>none</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>bochs</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ramfb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </video>
Aug 16 09:02:19 user nova-compute[73208]:     <hostdev supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='mode'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>subsystem</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='startupPolicy'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>default</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>mandatory</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>requisite</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>optional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='subsysType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pci</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='capsType'/>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='pciBackend'/>
Aug 16 09:02:19 user nova-compute[73208]:     </hostdev>
Aug 16 09:02:19 user nova-compute[73208]:     <rng supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>random</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egd</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>builtin</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </rng>
Aug 16 09:02:19 user nova-compute[73208]:     <filesystem supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='driverType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>path</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>handle</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtiofs</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </filesystem>
Aug 16 09:02:19 user nova-compute[73208]:     <tpm supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-tis</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-crb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>passthrough</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>emulator</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </tpm>
Aug 16 09:02:19 user nova-compute[73208]:   </devices>
Aug 16 09:02:19 user nova-compute[73208]:   <features>
Aug 16 09:02:19 user nova-compute[73208]:     <gic supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     <vmcoreinfo supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <genid supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backingStoreInput supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backup supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <sev supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:   </features>
Aug 16 09:02:19 user nova-compute[73208]: </domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 09:02:19 user nova-compute[73208]: <domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 09:02:19 user nova-compute[73208]:   <domain>kvm</domain>
Aug 16 09:02:19 user nova-compute[73208]:   <machine>pc-i440fx-6.2</machine>
Aug 16 09:02:19 user nova-compute[73208]:   <arch>x86_64</arch>
Aug 16 09:02:19 user nova-compute[73208]:   <vcpu max='255'/>
Aug 16 09:02:19 user nova-compute[73208]:   <iothreads supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:   <os supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='firmware'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>efi</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:     <loader supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>rom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pflash</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='readonly'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>yes</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='secure'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>no</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </loader>
Aug 16 09:02:19 user nova-compute[73208]:   </os>
Aug 16 09:02:19 user nova-compute[73208]:   <cpu>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-passthrough' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='hostPassthroughMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='maximum' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='maximumMigratable'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>on</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>off</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='host-model' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <vendor>Intel</vendor>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ss'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='vmx'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pcid'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='hypervisor'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arat'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='umip'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='md-clear'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='invtsc'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibpb'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='ibrs'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-stibp'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='rsba'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='erms'/>
Aug 16 09:02:19 user nova-compute[73208]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:     <mode name='custom' supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>qemu64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>qemu32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>phenom</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>pentium</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>n270</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm64</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>kvm32</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>coreduo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>core2duo</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>athlon</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Westmere</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Snowridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Skylake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>SandyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Penryn</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G5</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G4</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G3</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Opteron_G2</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Opteron_G1</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>IvyBridge</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Icelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Haswell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Rome</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-Milan</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>EPYC</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Dhyana</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cooperlake</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>Conroe</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='no'>Broadwell</model>
Aug 16 09:02:19 user nova-compute[73208]:       <model usable='yes'>486</model>
Aug 16 09:02:19 user nova-compute[73208]:     </mode>
Aug 16 09:02:19 user nova-compute[73208]:   </cpu>
Aug 16 09:02:19 user nova-compute[73208]:   <memoryBacking supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:     <enum name='sourceType'>
Aug 16 09:02:19 user nova-compute[73208]:       <value>file</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>anonymous</value>
Aug 16 09:02:19 user nova-compute[73208]:       <value>memfd</value>
Aug 16 09:02:19 user nova-compute[73208]:     </enum>
Aug 16 09:02:19 user nova-compute[73208]:   </memoryBacking>
Aug 16 09:02:19 user nova-compute[73208]:   <devices>
Aug 16 09:02:19 user nova-compute[73208]:     <disk supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='diskDevice'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>disk</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cdrom</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>floppy</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>lun</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='bus'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ide</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>fdc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sata</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </disk>
Aug 16 09:02:19 user nova-compute[73208]:     <graphics supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='type'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>sdl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vnc</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>spice</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egl-headless</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </graphics>
Aug 16 09:02:19 user nova-compute[73208]:     <video supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='modelType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>cirrus</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>vmvga</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>qxl</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>none</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>bochs</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>ramfb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </video>
Aug 16 09:02:19 user nova-compute[73208]:     <hostdev supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='mode'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>subsystem</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='startupPolicy'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>default</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>mandatory</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>requisite</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>optional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='subsysType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>usb</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>pci</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>scsi</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='capsType'/>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='pciBackend'/>
Aug 16 09:02:19 user nova-compute[73208]:     </hostdev>
Aug 16 09:02:19 user nova-compute[73208]:     <rng supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtio-non-transitional</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>random</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>egd</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>builtin</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </rng>
Aug 16 09:02:19 user nova-compute[73208]:     <filesystem supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='driverType'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>path</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>handle</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>virtiofs</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </filesystem>
Aug 16 09:02:19 user nova-compute[73208]:     <tpm supported='yes'>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='model'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-tis</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>tpm-crb</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:       <enum name='backendModel'>
Aug 16 09:02:19 user nova-compute[73208]:         <value>passthrough</value>
Aug 16 09:02:19 user nova-compute[73208]:         <value>emulator</value>
Aug 16 09:02:19 user nova-compute[73208]:       </enum>
Aug 16 09:02:19 user nova-compute[73208]:     </tpm>
Aug 16 09:02:19 user nova-compute[73208]:   </devices>
Aug 16 09:02:19 user nova-compute[73208]:   <features>
Aug 16 09:02:19 user nova-compute[73208]:     <gic supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:     <vmcoreinfo supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <genid supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backingStoreInput supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <backup supported='yes'/>
Aug 16 09:02:19 user nova-compute[73208]:     <sev supported='no'/>
Aug 16 09:02:19 user nova-compute[73208]:   </features>
Aug 16 09:02:19 user nova-compute[73208]: </domainCapabilities>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73208) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73208) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Checking secure boot support for host arch (x86_64) {{(pid=73208) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 09:02:19 user nova-compute[73208]: INFO nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Secure Boot support detected
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] cpu compare xml: <cpu match="exact">
Aug 16 09:02:19 user nova-compute[73208]:   <model>Nehalem</model>
Aug 16 09:02:19 user nova-compute[73208]: </cpu>
Aug 16 09:02:19 user nova-compute[73208]:  {{(pid=73208) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 09:02:19 user nova-compute[73208]: INFO nova.virt.node [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Generated node identity d9b267f9-36ef-4957-8c92-af6cce6eb509
Aug 16 09:02:19 user nova-compute[73208]: INFO nova.virt.node [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Wrote node identity d9b267f9-36ef-4957-8c92-af6cce6eb509 to /opt/stack/data/nova/compute_id
Aug 16 09:02:19 user nova-compute[73208]: WARNING nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Compute nodes ['d9b267f9-36ef-4957-8c92-af6cce6eb509'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 09:02:19 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 09:02:19 user nova-compute[73208]: WARNING nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 09:02:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:02:19 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:02:19 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Hypervisor/Node resource view: name=user free_ram=10876MB free_disk=26.39000701904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:02:19 user nova-compute[73208]: WARNING nova.compute.resource_tracker [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] No compute node record for user:d9b267f9-36ef-4957-8c92-af6cce6eb509: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d9b267f9-36ef-4957-8c92-af6cce6eb509 could not be found.
Aug 16 09:02:19 user nova-compute[73208]: INFO nova.compute.resource_tracker [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Compute node record created for user:user with uuid: d9b267f9-36ef-4957-8c92-af6cce6eb509
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:02:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:02:20 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [req-b3833999-2e4b-430e-b75c-6e18290608c0] Created resource provider record via placement API for resource provider with UUID d9b267f9-36ef-4957-8c92-af6cce6eb509 and name user.
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73208) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 09:02:20 user nova-compute[73208]: INFO nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] kernel doesn't support AMD SEV
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Libvirt baseline CPU <cpu>
Aug 16 09:02:20 user nova-compute[73208]:   <arch>x86_64</arch>
Aug 16 09:02:20 user nova-compute[73208]:   <model>Nehalem</model>
Aug 16 09:02:20 user nova-compute[73208]:   <vendor>Intel</vendor>
Aug 16 09:02:20 user nova-compute[73208]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 09:02:20 user nova-compute[73208]: </cpu>
Aug 16 09:02:20 user nova-compute[73208]:  {{(pid=73208) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Updated inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Updating resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 generation from 0 to 1 during operation: update_inventory {{(pid=73208) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Updating resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 generation from 1 to 2 during operation: update_traits {{(pid=73208) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.service [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Creating RPC server for service compute {{(pid=73208) start /opt/stack/nova/nova/service.py:182}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.service [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Join ServiceGroup membership for this service compute {{(pid=73208) start /opt/stack/nova/nova/service.py:199}}
Aug 16 09:02:20 user nova-compute[73208]: DEBUG nova.servicegroup.drivers.db [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73208) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 09:02:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_power_states {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:02:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:03:10 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:03:10 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:03:10 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=10283MB free_disk=26.293720245361328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:03:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:03:11 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:03:11 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:03:11 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:03:11 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:03:11 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:03:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:04:11 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:04:12 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:04:12 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:04:12 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=10176MB free_disk=26.33977508544922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:04:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:04:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:04:12 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:04:12 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:04:12 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:04:12 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:04:12 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:04:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:04:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:04:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:04:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:04:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:05:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:05:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:05:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:05:12 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:05:12 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:05:12 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:05:12 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:05:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:05:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:05:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:05:12 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:05:13 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:05:13 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:05:13 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=10208MB free_disk=26.12637710571289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:05:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:05:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:05:13 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:05:13 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:05:13 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:05:13 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:05:13 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:05:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:05:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:05:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:05:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:05:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:05:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:05:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:12 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:12 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:12 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:06:13 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:13 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:13 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=9495MB free_disk=26.15557098388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:06:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:13 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:06:13 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:06:13 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:06:13 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:06:13 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:06:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:06:31 user nova-compute[73208]: INFO nova.compute.claims [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Claim successful on node user
Aug 16 09:06:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:06:31 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.478s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:06:32 user nova-compute[73208]: INFO nova.compute.claims [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Claim successful on node user
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:06:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:06:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Creating image(s)
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "/opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "/opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:06:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:06:32 user nova-compute[73208]: INFO nova.compute.claims [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Claim successful on node user
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:06:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Creating image(s)
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.policy [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddf1f606b0a64c56a99a13f34f2bb159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73ed43465f748bbb8b91467184ce41c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.policy [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '858c944850cd4fe69b6c8f782cae394a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e96874fcad4d3b8fcd66f3f513b13d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484.part --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.virt.images [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] 57e619ae-e236-4dcb-9810-c1a72d3e5cd4 was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484.part /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.798s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484.part /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484.converted" returned: 0 in 0.149s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:06:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484.converted --force-share --output=json" returned: 0 in 0.163s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.179s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:33 user nova-compute[73208]: INFO oslo.privsep.daemon [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppp9a08ce/privsep.sock']
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.870s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:33 user sudo[82498]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppp9a08ce/privsep.sock
Aug 16 09:06:33 user sudo[82498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:06:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Creating image(s)
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "/opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "/opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "/opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:33 user nova-compute[73208]: DEBUG nova.policy [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e351e35970aa48028ad400bbda5403b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62017e5fe324a528f4ad1dc5c939498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:06:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:06:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:34 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:06:34 user nova-compute[73208]: INFO nova.compute.claims [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Claim successful on node user
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:06:35 user sudo[82498]: pam_unix(sudo:session): session closed for user root
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:06:35 user nova-compute[73208]: INFO oslo.privsep.daemon [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Spawned new privsep daemon via rootwrap
Aug 16 09:06:35 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 09:06:35 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 09:06:35 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 09:06:35 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82503
Aug 16 09:06:35 user nova-compute[73208]: WARNING oslo_privsep.priv_context [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] privsep daemon already running
Aug 16 09:06:35 user nova-compute[73208]: WARNING oslo_privsep.priv_context [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] privsep daemon already running
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:06:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:06:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Creating image(s)
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.244s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.264s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.161s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.policy [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e55042930262469a9989e0b9eaf44419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6f44a553f04c2288bdfa3593f90f87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk 1073741824" returned: 0 in 0.049s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.194s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.165s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.171s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk 1073741824" returned: 0 in 0.044s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.447s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Cannot resize image /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'migration_context' on Instance uuid aeff110f-8cbd-480d-8654-b0daee121eb7 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.network.neutron [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Successfully created port: 0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Ensure instance console log exists: /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.160s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.230s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk 1073741824" returned: 0 in 0.068s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.549s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Cannot resize image /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lazy-loading 'migration_context' on Instance uuid ee15c9d4-1895-4afa-bd25-d21098b0ca34 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Ensure instance console log exists: /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.218s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk 1073741824" returned: 0 in 0.055s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Cannot resize image /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'migration_context' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Ensure instance console log exists: /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.246s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Checking if we can resize image /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Successfully created port: 2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Cannot resize image /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'migration_context' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Ensure instance console log exists: /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Successfully created port: 7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:06:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:06:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:06:37 user nova-compute[73208]: INFO nova.compute.claims [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Claim successful on node user
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Successfully created port: 9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:06:38 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:06:38 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Creating image(s)
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Successfully updated port: 2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquired lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.policy [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '440128c7fc3046068e7020c70ffb25d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4186d2c7f14b4ab3010a7302f5f1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-150b27ae-3c5c-4bab-8dc9-f53e252109c5 req-5dc92adf-1772-4be4-b877-ab6bebe89b47 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received event network-changed-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-150b27ae-3c5c-4bab-8dc9-f53e252109c5 req-5dc92adf-1772-4be4-b877-ab6bebe89b47 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Refreshing instance network info cache due to event network-changed-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-150b27ae-3c5c-4bab-8dc9-f53e252109c5 req-5dc92adf-1772-4be4-b877-ab6bebe89b47 service nova] Acquiring lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk 1073741824" returned: 0 in 0.054s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Cannot resize image /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'migration_context' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Ensure instance console log exists: /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Successfully updated port: 0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Updating instance_info_cache with network_info: [{"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquired lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Releasing lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Instance network_info: |[{"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-150b27ae-3c5c-4bab-8dc9-f53e252109c5 req-5dc92adf-1772-4be4-b877-ab6bebe89b47 service nova] Acquired lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-150b27ae-3c5c-4bab-8dc9-f53e252109c5 req-5dc92adf-1772-4be4-b877-ab6bebe89b47 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Refreshing network info cache for port 2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Start _get_guest_xml network_info=[{"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:06:40 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:40 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1226920265',display_name='tempest-DeleteServersTestJSON-server-1226920265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1226920265',id=1,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a73ed43465f748bbb8b91467184ce41c',ramdisk_id='',reservation_id='r-4ilu0pbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1038611982',owner_user_name='tempest-DeleteServersTestJSON-1038611982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:32Z,user_data=None,user_id='ddf1f606b0a64c56a99a13f34f2bb159',uuid=ee15c9d4-1895-4afa-bd25-d21098b0ca34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Converting VIF {"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:63:21,bridge_name='br-int',has_traffic_filtering=True,id=2b7b3495-6e5d-458a-a3ee-720b6ed38b9f,network=Network(6f74347e-6883-478d-83c8-987d3d22c22d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7b3495-6e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.objects.instance [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lazy-loading 'pci_devices' on Instance uuid ee15c9d4-1895-4afa-bd25-d21098b0ca34 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:06:40 user nova-compute[73208]:   <uuid>ee15c9d4-1895-4afa-bd25-d21098b0ca34</uuid>
Aug 16 09:06:40 user nova-compute[73208]:   <name>instance-00000001</name>
Aug 16 09:06:40 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:06:40 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:06:40 user nova-compute[73208]:   <metadata>
Aug 16 09:06:40 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:06:40 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:06:40 user nova-compute[73208]:       <nova:name>tempest-DeleteServersTestJSON-server-1226920265</nova:name>
Aug 16 09:06:40 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:06:40</nova:creationTime>
Aug 16 09:06:40 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:06:40 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:06:40 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:06:40 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:06:40 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:06:40 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:06:40 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:06:40 user nova-compute[73208]:       <nova:owner>
Aug 16 09:06:40 user nova-compute[73208]:         <nova:user uuid="ddf1f606b0a64c56a99a13f34f2bb159">tempest-DeleteServersTestJSON-1038611982-project-member</nova:user>
Aug 16 09:06:40 user nova-compute[73208]:         <nova:project uuid="a73ed43465f748bbb8b91467184ce41c">tempest-DeleteServersTestJSON-1038611982</nova:project>
Aug 16 09:06:40 user nova-compute[73208]:       </nova:owner>
Aug 16 09:06:40 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:06:40 user nova-compute[73208]:       <nova:ports>
Aug 16 09:06:40 user nova-compute[73208]:         <nova:port uuid="2b7b3495-6e5d-458a-a3ee-720b6ed38b9f">
Aug 16 09:06:40 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 09:06:40 user nova-compute[73208]:         </nova:port>
Aug 16 09:06:40 user nova-compute[73208]:       </nova:ports>
Aug 16 09:06:40 user nova-compute[73208]:     </nova:instance>
Aug 16 09:06:40 user nova-compute[73208]:   </metadata>
Aug 16 09:06:40 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:06:40 user nova-compute[73208]:     <system>
Aug 16 09:06:40 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:06:40 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:06:40 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:06:40 user nova-compute[73208]:       <entry name="serial">ee15c9d4-1895-4afa-bd25-d21098b0ca34</entry>
Aug 16 09:06:40 user nova-compute[73208]:       <entry name="uuid">ee15c9d4-1895-4afa-bd25-d21098b0ca34</entry>
Aug 16 09:06:40 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:06:40 user nova-compute[73208]:     </system>
Aug 16 09:06:40 user nova-compute[73208]:   </sysinfo>
Aug 16 09:06:40 user nova-compute[73208]:   <os>
Aug 16 09:06:40 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:06:40 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:06:40 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:06:40 user nova-compute[73208]:   </os>
Aug 16 09:06:40 user nova-compute[73208]:   <features>
Aug 16 09:06:40 user nova-compute[73208]:     <acpi/>
Aug 16 09:06:40 user nova-compute[73208]:     <apic/>
Aug 16 09:06:40 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:06:40 user nova-compute[73208]:   </features>
Aug 16 09:06:40 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:06:40 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:06:40 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:06:40 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:06:40 user nova-compute[73208]:   </clock>
Aug 16 09:06:40 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:06:40 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:06:40 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:06:40 user nova-compute[73208]:   </cpu>
Aug 16 09:06:40 user nova-compute[73208]:   <devices>
Aug 16 09:06:40 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:06:40 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:06:40 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk"/>
Aug 16 09:06:40 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:06:40 user nova-compute[73208]:     </disk>
Aug 16 09:06:40 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:06:40 user nova-compute[73208]:       <mac address="fa:16:3e:4b:63:21"/>
Aug 16 09:06:40 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:40 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:06:40 user nova-compute[73208]:       <target dev="tap2b7b3495-6e"/>
Aug 16 09:06:40 user nova-compute[73208]:     </interface>
Aug 16 09:06:40 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:06:40 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/console.log" append="off"/>
Aug 16 09:06:40 user nova-compute[73208]:     </serial>
Aug 16 09:06:40 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:06:40 user nova-compute[73208]:     <video>
Aug 16 09:06:40 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:40 user nova-compute[73208]:     </video>
Aug 16 09:06:40 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:06:40 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:06:40 user nova-compute[73208]:     </rng>
Aug 16 09:06:40 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:06:40 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:06:40 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:06:40 user nova-compute[73208]:     </memballoon>
Aug 16 09:06:40 user nova-compute[73208]:   </devices>
Aug 16 09:06:40 user nova-compute[73208]: </domain>
Aug 16 09:06:40 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1226920265',display_name='tempest-DeleteServersTestJSON-server-1226920265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1226920265',id=1,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a73ed43465f748bbb8b91467184ce41c',ramdisk_id='',reservation_id='r-4ilu0pbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1038611982',owner_user_name='tempest-DeleteServersTestJSON-1038611982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:32Z,user_data=None,user_id='ddf1f606b0a64c56a99a13f34f2bb159',uuid=ee15c9d4-1895-4afa-bd25-d21098b0ca34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Converting VIF {"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:63:21,bridge_name='br-int',has_traffic_filtering=True,id=2b7b3495-6e5d-458a-a3ee-720b6ed38b9f,network=Network(6f74347e-6883-478d-83c8-987d3d22c22d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7b3495-6e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG os_vif [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:63:21,bridge_name='br-int',has_traffic_filtering=True,id=2b7b3495-6e5d-458a-a3ee-720b6ed38b9f,network=Network(6f74347e-6883-478d-83c8-987d3d22c22d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7b3495-6e') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Created schema index Interface.name {{(pid=73208) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Created schema index Port.name {{(pid=73208) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Created schema index Bridge.name {{(pid=73208) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [POLLOUT] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d632826-02d4-4998-be3d-edc9fd7698a6 req-32053194-8916-46c3-b695-2afa930aaf7e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-changed-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d632826-02d4-4998-be3d-edc9fd7698a6 req-32053194-8916-46c3-b695-2afa930aaf7e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Refreshing instance network info cache due to event network-changed-0bbaa277-2952-499a-9b56-e0dc09d81095. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d632826-02d4-4998-be3d-edc9fd7698a6 req-32053194-8916-46c3-b695-2afa930aaf7e service nova] Acquiring lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:06:40 user nova-compute[73208]: INFO oslo.privsep.daemon [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp46dnt8h7/privsep.sock']
Aug 16 09:06:40 user sudo[82614]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp46dnt8h7/privsep.sock
Aug 16 09:06:40 user sudo[82614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Successfully updated port: 7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquired lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Releasing lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance network_info: |[{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d632826-02d4-4998-be3d-edc9fd7698a6 req-32053194-8916-46c3-b695-2afa930aaf7e service nova] Acquired lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.neutron [req-3d632826-02d4-4998-be3d-edc9fd7698a6 req-32053194-8916-46c3-b695-2afa930aaf7e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Refreshing network info cache for port 0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Start _get_guest_xml network_info=[{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:06:41 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:41 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-86453005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-86453005',id=2,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvQS8OkM6GCnnBI8vpSyzDNIWEWgT4Zn8HYodhu7szkC4i1yM7sLrd6tfpdIyvnrxwRg48+yftTDYkD1C5MKrNOy2sRzTHbubhSOoRIp/Sb2Lh31W/68eSiGtoRtQKFSg==',key_name='tempest-keypair-1433315580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-22bku0a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b78d27e-d22f-45a7-8fd4-0d0366fd68ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.objects.instance [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:06:41 user nova-compute[73208]:   <uuid>8b78d27e-d22f-45a7-8fd4-0d0366fd68ad</uuid>
Aug 16 09:06:41 user nova-compute[73208]:   <name>instance-00000002</name>
Aug 16 09:06:41 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:06:41 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:06:41 user nova-compute[73208]:   <metadata>
Aug 16 09:06:41 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:06:41 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:06:41 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-86453005</nova:name>
Aug 16 09:06:41 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:06:41</nova:creationTime>
Aug 16 09:06:41 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:06:41 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:06:41 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:06:41 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:06:41 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:06:41 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:06:41 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:06:41 user nova-compute[73208]:       <nova:owner>
Aug 16 09:06:41 user nova-compute[73208]:         <nova:user uuid="858c944850cd4fe69b6c8f782cae394a">tempest-AttachVolumeShelveTestJSON-1142897180-project-member</nova:user>
Aug 16 09:06:41 user nova-compute[73208]:         <nova:project uuid="05e96874fcad4d3b8fcd66f3f513b13d">tempest-AttachVolumeShelveTestJSON-1142897180</nova:project>
Aug 16 09:06:41 user nova-compute[73208]:       </nova:owner>
Aug 16 09:06:41 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:06:41 user nova-compute[73208]:       <nova:ports>
Aug 16 09:06:41 user nova-compute[73208]:         <nova:port uuid="0bbaa277-2952-499a-9b56-e0dc09d81095">
Aug 16 09:06:41 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 09:06:41 user nova-compute[73208]:         </nova:port>
Aug 16 09:06:41 user nova-compute[73208]:       </nova:ports>
Aug 16 09:06:41 user nova-compute[73208]:     </nova:instance>
Aug 16 09:06:41 user nova-compute[73208]:   </metadata>
Aug 16 09:06:41 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:06:41 user nova-compute[73208]:     <system>
Aug 16 09:06:41 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:06:41 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:06:41 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:06:41 user nova-compute[73208]:       <entry name="serial">8b78d27e-d22f-45a7-8fd4-0d0366fd68ad</entry>
Aug 16 09:06:41 user nova-compute[73208]:       <entry name="uuid">8b78d27e-d22f-45a7-8fd4-0d0366fd68ad</entry>
Aug 16 09:06:41 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:06:41 user nova-compute[73208]:     </system>
Aug 16 09:06:41 user nova-compute[73208]:   </sysinfo>
Aug 16 09:06:41 user nova-compute[73208]:   <os>
Aug 16 09:06:41 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:06:41 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:06:41 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:06:41 user nova-compute[73208]:   </os>
Aug 16 09:06:41 user nova-compute[73208]:   <features>
Aug 16 09:06:41 user nova-compute[73208]:     <acpi/>
Aug 16 09:06:41 user nova-compute[73208]:     <apic/>
Aug 16 09:06:41 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:06:41 user nova-compute[73208]:   </features>
Aug 16 09:06:41 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:06:41 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:06:41 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:06:41 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:06:41 user nova-compute[73208]:   </clock>
Aug 16 09:06:41 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:06:41 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:06:41 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:06:41 user nova-compute[73208]:   </cpu>
Aug 16 09:06:41 user nova-compute[73208]:   <devices>
Aug 16 09:06:41 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:06:41 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:06:41 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk"/>
Aug 16 09:06:41 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:06:41 user nova-compute[73208]:     </disk>
Aug 16 09:06:41 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:06:41 user nova-compute[73208]:       <mac address="fa:16:3e:8d:02:a6"/>
Aug 16 09:06:41 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:41 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:06:41 user nova-compute[73208]:       <target dev="tap0bbaa277-29"/>
Aug 16 09:06:41 user nova-compute[73208]:     </interface>
Aug 16 09:06:41 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:06:41 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/console.log" append="off"/>
Aug 16 09:06:41 user nova-compute[73208]:     </serial>
Aug 16 09:06:41 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:06:41 user nova-compute[73208]:     <video>
Aug 16 09:06:41 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:41 user nova-compute[73208]:     </video>
Aug 16 09:06:41 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:06:41 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:06:41 user nova-compute[73208]:     </rng>
Aug 16 09:06:41 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:06:41 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:06:41 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:06:41 user nova-compute[73208]:     </memballoon>
Aug 16 09:06:41 user nova-compute[73208]:   </devices>
Aug 16 09:06:41 user nova-compute[73208]: </domain>
Aug 16 09:06:41 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-86453005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-86453005',id=2,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvQS8OkM6GCnnBI8vpSyzDNIWEWgT4Zn8HYodhu7szkC4i1yM7sLrd6tfpdIyvnrxwRg48+yftTDYkD1C5MKrNOy2sRzTHbubhSOoRIp/Sb2Lh31W/68eSiGtoRtQKFSg==',key_name='tempest-keypair-1433315580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-22bku0a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b78d27e-d22f-45a7-8fd4-0d0366fd68ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG os_vif [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Successfully updated port: 9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-222051c6-a0e5-4ee6-833e-714732a3c043 req-44fb3020-afa6-4585-b9e2-26377bc6558c service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-changed-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-222051c6-a0e5-4ee6-833e-714732a3c043 req-44fb3020-afa6-4585-b9e2-26377bc6558c service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Refreshing instance network info cache due to event network-changed-9b934682-5a56-428d-8362-8cb499a85a94. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-222051c6-a0e5-4ee6-833e-714732a3c043 req-44fb3020-afa6-4585-b9e2-26377bc6558c service nova] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:42 user sudo[82614]: pam_unix(sudo:session): session closed for user root
Aug 16 09:06:42 user nova-compute[73208]: INFO oslo.privsep.daemon [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Spawned new privsep daemon via rootwrap
Aug 16 09:06:42 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 09:06:42 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 09:06:42 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 09:06:42 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82619
Aug 16 09:06:42 user nova-compute[73208]: WARNING oslo_privsep.priv_context [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] privsep daemon already running
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.network.neutron [req-3d632826-02d4-4998-be3d-edc9fd7698a6 req-32053194-8916-46c3-b695-2afa930aaf7e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updated VIF entry in instance network info cache for port 0bbaa277-2952-499a-9b56-e0dc09d81095. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.network.neutron [req-3d632826-02d4-4998-be3d-edc9fd7698a6 req-32053194-8916-46c3-b695-2afa930aaf7e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d632826-02d4-4998-be3d-edc9fd7698a6 req-32053194-8916-46c3-b695-2afa930aaf7e service nova] Releasing lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Successfully created port: 898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.network.neutron [req-150b27ae-3c5c-4bab-8dc9-f53e252109c5 req-5dc92adf-1772-4be4-b877-ab6bebe89b47 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Updated VIF entry in instance network info cache for port 2b7b3495-6e5d-458a-a3ee-720b6ed38b9f. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.network.neutron [req-150b27ae-3c5c-4bab-8dc9-f53e252109c5 req-5dc92adf-1772-4be4-b877-ab6bebe89b47 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Updating instance_info_cache with network_info: [{"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-150b27ae-3c5c-4bab-8dc9-f53e252109c5 req-5dc92adf-1772-4be4-b877-ab6bebe89b47 service nova] Releasing lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-8aa6bd6a-f68b-4c6e-b259-0cbd22b3637e req-a4624731-b282-4744-b48d-8cf15ce2d7b1 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-changed-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-8aa6bd6a-f68b-4c6e-b259-0cbd22b3637e req-a4624731-b282-4744-b48d-8cf15ce2d7b1 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Refreshing instance network info cache due to event network-changed-7a69891b-a5ef-4e60-9977-86c0cad59f1c. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8aa6bd6a-f68b-4c6e-b259-0cbd22b3637e req-a4624731-b282-4744-b48d-8cf15ce2d7b1 service nova] Acquiring lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance network_info: |[{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-222051c6-a0e5-4ee6-833e-714732a3c043 req-44fb3020-afa6-4585-b9e2-26377bc6558c service nova] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.network.neutron [req-222051c6-a0e5-4ee6-833e-714732a3c043 req-44fb3020-afa6-4585-b9e2-26377bc6558c service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Refreshing network info cache for port 9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Start _get_guest_xml network_info=[{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bbaa277-29, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bbaa277-29, col_values=(('external_ids', {'iface-id': '0bbaa277-2952-499a-9b56-e0dc09d81095', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:02:a6', 'vm-uuid': '8b78d27e-d22f-45a7-8fd4-0d0366fd68ad'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:42 user nova-compute[73208]: INFO os_vif [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29')
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b7b3495-6e, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b7b3495-6e, col_values=(('external_ids', {'iface-id': '2b7b3495-6e5d-458a-a3ee-720b6ed38b9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:63:21', 'vm-uuid': 'ee15c9d4-1895-4afa-bd25-d21098b0ca34'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:06:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'pci_devices' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: INFO os_vif [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:63:21,bridge_name='br-int',has_traffic_filtering=True,id=2b7b3495-6e5d-458a-a3ee-720b6ed38b9f,network=Network(6f74347e-6883-478d-83c8-987d3d22c22d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7b3495-6e')
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:06:43 user nova-compute[73208]:   <uuid>beb4ea79-b782-4540-8814-09b15002b432</uuid>
Aug 16 09:06:43 user nova-compute[73208]:   <name>instance-00000004</name>
Aug 16 09:06:43 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:06:43 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:06:43 user nova-compute[73208]:   <metadata>
Aug 16 09:06:43 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:06:43 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:name>tempest-ServerActionsTestOtherB-server-516370955</nova:name>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:06:42</nova:creationTime>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:06:43 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:06:43 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:owner>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:user uuid="e55042930262469a9989e0b9eaf44419">tempest-ServerActionsTestOtherB-1962627754-project-member</nova:user>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:project uuid="cc6f44a553f04c2288bdfa3593f90f87">tempest-ServerActionsTestOtherB-1962627754</nova:project>
Aug 16 09:06:43 user nova-compute[73208]:       </nova:owner>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:ports>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:port uuid="9b934682-5a56-428d-8362-8cb499a85a94">
Aug 16 09:06:43 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 09:06:43 user nova-compute[73208]:         </nova:port>
Aug 16 09:06:43 user nova-compute[73208]:       </nova:ports>
Aug 16 09:06:43 user nova-compute[73208]:     </nova:instance>
Aug 16 09:06:43 user nova-compute[73208]:   </metadata>
Aug 16 09:06:43 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:06:43 user nova-compute[73208]:     <system>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="serial">beb4ea79-b782-4540-8814-09b15002b432</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="uuid">beb4ea79-b782-4540-8814-09b15002b432</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:06:43 user nova-compute[73208]:     </system>
Aug 16 09:06:43 user nova-compute[73208]:   </sysinfo>
Aug 16 09:06:43 user nova-compute[73208]:   <os>
Aug 16 09:06:43 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:06:43 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:06:43 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:06:43 user nova-compute[73208]:   </os>
Aug 16 09:06:43 user nova-compute[73208]:   <features>
Aug 16 09:06:43 user nova-compute[73208]:     <acpi/>
Aug 16 09:06:43 user nova-compute[73208]:     <apic/>
Aug 16 09:06:43 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:06:43 user nova-compute[73208]:   </features>
Aug 16 09:06:43 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:06:43 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:06:43 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:06:43 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:06:43 user nova-compute[73208]:   </clock>
Aug 16 09:06:43 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:06:43 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:06:43 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:06:43 user nova-compute[73208]:   </cpu>
Aug 16 09:06:43 user nova-compute[73208]:   <devices>
Aug 16 09:06:43 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:06:43 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:06:43 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk"/>
Aug 16 09:06:43 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:06:43 user nova-compute[73208]:     </disk>
Aug 16 09:06:43 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:06:43 user nova-compute[73208]:       <mac address="fa:16:3e:e0:7b:07"/>
Aug 16 09:06:43 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:43 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:06:43 user nova-compute[73208]:       <target dev="tap9b934682-5a"/>
Aug 16 09:06:43 user nova-compute[73208]:     </interface>
Aug 16 09:06:43 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:06:43 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/console.log" append="off"/>
Aug 16 09:06:43 user nova-compute[73208]:     </serial>
Aug 16 09:06:43 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:06:43 user nova-compute[73208]:     <video>
Aug 16 09:06:43 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:43 user nova-compute[73208]:     </video>
Aug 16 09:06:43 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:06:43 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:06:43 user nova-compute[73208]:     </rng>
Aug 16 09:06:43 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:06:43 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:06:43 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:06:43 user nova-compute[73208]:     </memballoon>
Aug 16 09:06:43 user nova-compute[73208]:   </devices>
Aug 16 09:06:43 user nova-compute[73208]: </domain>
Aug 16 09:06:43 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG os_vif [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b934682-5a, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b934682-5a, col_values=(('external_ids', {'iface-id': '9b934682-5a56-428d-8362-8cb499a85a94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:7b:07', 'vm-uuid': 'beb4ea79-b782-4540-8814-09b15002b432'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Releasing lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Instance network_info: |[{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8aa6bd6a-f68b-4c6e-b259-0cbd22b3637e req-a4624731-b282-4744-b48d-8cf15ce2d7b1 service nova] Acquired lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.neutron [req-8aa6bd6a-f68b-4c6e-b259-0cbd22b3637e req-a4624731-b282-4744-b48d-8cf15ce2d7b1 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Refreshing network info cache for port 7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Start _get_guest_xml network_info=[{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: INFO os_vif [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a')
Aug 16 09:06:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] No VIF found with MAC fa:16:3e:4b:63:21, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No VIF found with MAC fa:16:3e:8d:02:a6, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1001827453',display_name='tempest-ServerActionsTestOtherA-server-1001827453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1001827453',id=3,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-jdms0qnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=aeff110f-8cbd-480d-8654-b0daee121eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2f:51,bridge_name='br-int',has_traffic_filtering=True,id=7a69891b-a5ef-4e60-9977-86c0cad59f1c,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a69891b-a5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'pci_devices' on Instance uuid aeff110f-8cbd-480d-8654-b0daee121eb7 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:06:43 user nova-compute[73208]:   <uuid>aeff110f-8cbd-480d-8654-b0daee121eb7</uuid>
Aug 16 09:06:43 user nova-compute[73208]:   <name>instance-00000003</name>
Aug 16 09:06:43 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:06:43 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:06:43 user nova-compute[73208]:   <metadata>
Aug 16 09:06:43 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:06:43 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:name>tempest-ServerActionsTestOtherA-server-1001827453</nova:name>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:06:43</nova:creationTime>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:06:43 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:06:43 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:owner>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:user uuid="e351e35970aa48028ad400bbda5403b1">tempest-ServerActionsTestOtherA-1386845270-project-member</nova:user>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:project uuid="d62017e5fe324a528f4ad1dc5c939498">tempest-ServerActionsTestOtherA-1386845270</nova:project>
Aug 16 09:06:43 user nova-compute[73208]:       </nova:owner>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:06:43 user nova-compute[73208]:       <nova:ports>
Aug 16 09:06:43 user nova-compute[73208]:         <nova:port uuid="7a69891b-a5ef-4e60-9977-86c0cad59f1c">
Aug 16 09:06:43 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 09:06:43 user nova-compute[73208]:         </nova:port>
Aug 16 09:06:43 user nova-compute[73208]:       </nova:ports>
Aug 16 09:06:43 user nova-compute[73208]:     </nova:instance>
Aug 16 09:06:43 user nova-compute[73208]:   </metadata>
Aug 16 09:06:43 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:06:43 user nova-compute[73208]:     <system>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="serial">aeff110f-8cbd-480d-8654-b0daee121eb7</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="uuid">aeff110f-8cbd-480d-8654-b0daee121eb7</entry>
Aug 16 09:06:43 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:06:43 user nova-compute[73208]:     </system>
Aug 16 09:06:43 user nova-compute[73208]:   </sysinfo>
Aug 16 09:06:43 user nova-compute[73208]:   <os>
Aug 16 09:06:43 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:06:43 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:06:43 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:06:43 user nova-compute[73208]:   </os>
Aug 16 09:06:43 user nova-compute[73208]:   <features>
Aug 16 09:06:43 user nova-compute[73208]:     <acpi/>
Aug 16 09:06:43 user nova-compute[73208]:     <apic/>
Aug 16 09:06:43 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:06:43 user nova-compute[73208]:   </features>
Aug 16 09:06:43 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:06:43 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:06:43 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:06:43 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:06:43 user nova-compute[73208]:   </clock>
Aug 16 09:06:43 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:06:43 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:06:43 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:06:43 user nova-compute[73208]:   </cpu>
Aug 16 09:06:43 user nova-compute[73208]:   <devices>
Aug 16 09:06:43 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:06:43 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:06:43 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk"/>
Aug 16 09:06:43 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:06:43 user nova-compute[73208]:     </disk>
Aug 16 09:06:43 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:06:43 user nova-compute[73208]:       <mac address="fa:16:3e:b8:2f:51"/>
Aug 16 09:06:43 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:43 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:06:43 user nova-compute[73208]:       <target dev="tap7a69891b-a5"/>
Aug 16 09:06:43 user nova-compute[73208]:     </interface>
Aug 16 09:06:43 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:06:43 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/console.log" append="off"/>
Aug 16 09:06:43 user nova-compute[73208]:     </serial>
Aug 16 09:06:43 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:06:43 user nova-compute[73208]:     <video>
Aug 16 09:06:43 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:43 user nova-compute[73208]:     </video>
Aug 16 09:06:43 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:06:43 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:06:43 user nova-compute[73208]:     </rng>
Aug 16 09:06:43 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:06:43 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:06:43 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:06:43 user nova-compute[73208]:     </memballoon>
Aug 16 09:06:43 user nova-compute[73208]:   </devices>
Aug 16 09:06:43 user nova-compute[73208]: </domain>
Aug 16 09:06:43 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1001827453',display_name='tempest-ServerActionsTestOtherA-server-1001827453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1001827453',id=3,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-jdms0qnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=aeff110f-8cbd-480d-8654-b0daee121eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2f:51,bridge_name='br-int',has_traffic_filtering=True,id=7a69891b-a5ef-4e60-9977-86c0cad59f1c,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a69891b-a5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG os_vif [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2f:51,bridge_name='br-int',has_traffic_filtering=True,id=7a69891b-a5ef-4e60-9977-86c0cad59f1c,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a69891b-a5') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a69891b-a5, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a69891b-a5, col_values=(('external_ids', {'iface-id': '7a69891b-a5ef-4e60-9977-86c0cad59f1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:2f:51', 'vm-uuid': 'aeff110f-8cbd-480d-8654-b0daee121eb7'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] No VIF found with MAC fa:16:3e:e0:7b:07, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:43 user nova-compute[73208]: INFO os_vif [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2f:51,bridge_name='br-int',has_traffic_filtering=True,id=7a69891b-a5ef-4e60-9977-86c0cad59f1c,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a69891b-a5')
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No VIF found with MAC fa:16:3e:b8:2f:51, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:06:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-222051c6-a0e5-4ee6-833e-714732a3c043 req-44fb3020-afa6-4585-b9e2-26377bc6558c service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updated VIF entry in instance network info cache for port 9b934682-5a56-428d-8362-8cb499a85a94. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:06:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-222051c6-a0e5-4ee6-833e-714732a3c043 req-44fb3020-afa6-4585-b9e2-26377bc6558c service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-222051c6-a0e5-4ee6-833e-714732a3c043 req-44fb3020-afa6-4585-b9e2-26377bc6558c service nova] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:45 user nova-compute[73208]: DEBUG nova.network.neutron [req-8aa6bd6a-f68b-4c6e-b259-0cbd22b3637e req-a4624731-b282-4744-b48d-8cf15ce2d7b1 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updated VIF entry in instance network info cache for port 7a69891b-a5ef-4e60-9977-86c0cad59f1c. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:06:45 user nova-compute[73208]: DEBUG nova.network.neutron [req-8aa6bd6a-f68b-4c6e-b259-0cbd22b3637e req-a4624731-b282-4744-b48d-8cf15ce2d7b1 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8aa6bd6a-f68b-4c6e-b259-0cbd22b3637e req-a4624731-b282-4744-b48d-8cf15ce2d7b1 service nova] Releasing lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:46 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Successfully updated port: 898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:06:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquired lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:46 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:06:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-21ccd865-5a91-4742-a4fd-aeab250114c2 req-c578d59d-9f24-4b25-a490-36714e424999 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-changed-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-21ccd865-5a91-4742-a4fd-aeab250114c2 req-c578d59d-9f24-4b25-a490-36714e424999 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Refreshing instance network info cache due to event network-changed-898d4cd1-4f35-4e2c-b563-202493263a7b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:06:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-21ccd865-5a91-4742-a4fd-aeab250114c2 req-c578d59d-9f24-4b25-a490-36714e424999 service nova] Acquiring lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:46 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating instance_info_cache with network_info: [{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Releasing lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance network_info: |[{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-21ccd865-5a91-4742-a4fd-aeab250114c2 req-c578d59d-9f24-4b25-a490-36714e424999 service nova] Acquired lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.network.neutron [req-21ccd865-5a91-4742-a4fd-aeab250114c2 req-c578d59d-9f24-4b25-a490-36714e424999 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Refreshing network info cache for port 898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Start _get_guest_xml network_info=[{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:06:47 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:47 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:06:47 user nova-compute[73208]:   <uuid>9fad0fe4-79f6-4023-8119-f076ba45cf4e</uuid>
Aug 16 09:06:47 user nova-compute[73208]:   <name>instance-00000005</name>
Aug 16 09:06:47 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:06:47 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:06:47 user nova-compute[73208]:   <metadata>
Aug 16 09:06:47 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:06:47 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:06:47 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeTestJSON-server-1426683030</nova:name>
Aug 16 09:06:47 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:06:47</nova:creationTime>
Aug 16 09:06:47 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:06:47 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:06:47 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:06:47 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:06:47 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:06:47 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:06:47 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:06:47 user nova-compute[73208]:       <nova:owner>
Aug 16 09:06:47 user nova-compute[73208]:         <nova:user uuid="440128c7fc3046068e7020c70ffb25d9">tempest-AttachVolumeTestJSON-60014534-project-member</nova:user>
Aug 16 09:06:47 user nova-compute[73208]:         <nova:project uuid="9e4186d2c7f14b4ab3010a7302f5f1d3">tempest-AttachVolumeTestJSON-60014534</nova:project>
Aug 16 09:06:47 user nova-compute[73208]:       </nova:owner>
Aug 16 09:06:47 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:06:47 user nova-compute[73208]:       <nova:ports>
Aug 16 09:06:47 user nova-compute[73208]:         <nova:port uuid="898d4cd1-4f35-4e2c-b563-202493263a7b">
Aug 16 09:06:47 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 09:06:47 user nova-compute[73208]:         </nova:port>
Aug 16 09:06:47 user nova-compute[73208]:       </nova:ports>
Aug 16 09:06:47 user nova-compute[73208]:     </nova:instance>
Aug 16 09:06:47 user nova-compute[73208]:   </metadata>
Aug 16 09:06:47 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:06:47 user nova-compute[73208]:     <system>
Aug 16 09:06:47 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:06:47 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:06:47 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:06:47 user nova-compute[73208]:       <entry name="serial">9fad0fe4-79f6-4023-8119-f076ba45cf4e</entry>
Aug 16 09:06:47 user nova-compute[73208]:       <entry name="uuid">9fad0fe4-79f6-4023-8119-f076ba45cf4e</entry>
Aug 16 09:06:47 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:06:47 user nova-compute[73208]:     </system>
Aug 16 09:06:47 user nova-compute[73208]:   </sysinfo>
Aug 16 09:06:47 user nova-compute[73208]:   <os>
Aug 16 09:06:47 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:06:47 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:06:47 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:06:47 user nova-compute[73208]:   </os>
Aug 16 09:06:47 user nova-compute[73208]:   <features>
Aug 16 09:06:47 user nova-compute[73208]:     <acpi/>
Aug 16 09:06:47 user nova-compute[73208]:     <apic/>
Aug 16 09:06:47 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:06:47 user nova-compute[73208]:   </features>
Aug 16 09:06:47 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:06:47 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:06:47 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:06:47 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:06:47 user nova-compute[73208]:   </clock>
Aug 16 09:06:47 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:06:47 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:06:47 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:06:47 user nova-compute[73208]:   </cpu>
Aug 16 09:06:47 user nova-compute[73208]:   <devices>
Aug 16 09:06:47 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:06:47 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:06:47 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk"/>
Aug 16 09:06:47 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:06:47 user nova-compute[73208]:     </disk>
Aug 16 09:06:47 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:06:47 user nova-compute[73208]:       <mac address="fa:16:3e:28:fe:95"/>
Aug 16 09:06:47 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:47 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:06:47 user nova-compute[73208]:       <target dev="tap898d4cd1-4f"/>
Aug 16 09:06:47 user nova-compute[73208]:     </interface>
Aug 16 09:06:47 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:06:47 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/console.log" append="off"/>
Aug 16 09:06:47 user nova-compute[73208]:     </serial>
Aug 16 09:06:47 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:06:47 user nova-compute[73208]:     <video>
Aug 16 09:06:47 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:47 user nova-compute[73208]:     </video>
Aug 16 09:06:47 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:06:47 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:06:47 user nova-compute[73208]:     </rng>
Aug 16 09:06:47 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:06:47 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:06:47 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:06:47 user nova-compute[73208]:     </memballoon>
Aug 16 09:06:47 user nova-compute[73208]:   </devices>
Aug 16 09:06:47 user nova-compute[73208]: </domain>
Aug 16 09:06:47 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG os_vif [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap898d4cd1-4f, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap898d4cd1-4f, col_values=(('external_ids', {'iface-id': '898d4cd1-4f35-4e2c-b563-202493263a7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:fe:95', 'vm-uuid': '9fad0fe4-79f6-4023-8119-f076ba45cf4e'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:47 user nova-compute[73208]: INFO os_vif [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f')
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:06:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No VIF found with MAC fa:16:3e:28:fe:95, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:06:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-21ccd865-5a91-4742-a4fd-aeab250114c2 req-c578d59d-9f24-4b25-a490-36714e424999 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updated VIF entry in instance network info cache for port 898d4cd1-4f35-4e2c-b563-202493263a7b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:06:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-21ccd865-5a91-4742-a4fd-aeab250114c2 req-c578d59d-9f24-4b25-a490-36714e424999 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating instance_info_cache with network_info: [{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-21ccd865-5a91-4742-a4fd-aeab250114c2 req-c578d59d-9f24-4b25-a490-36714e424999 service nova] Releasing lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-f74fc331-4f56-4bad-959a-b028a4f0985b req-61138da9-762a-4796-a9b5-c2ca3945d862 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f74fc331-4f56-4bad-959a-b028a4f0985b req-61138da9-762a-4796-a9b5-c2ca3945d862 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f74fc331-4f56-4bad-959a-b028a4f0985b req-61138da9-762a-4796-a9b5-c2ca3945d862 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f74fc331-4f56-4bad-959a-b028a4f0985b req-61138da9-762a-4796-a9b5-c2ca3945d862 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-f74fc331-4f56-4bad-959a-b028a4f0985b req-61138da9-762a-4796-a9b5-c2ca3945d862 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:06:49 user nova-compute[73208]: WARNING nova.compute.manager [req-f74fc331-4f56-4bad-959a-b028a4f0985b req-61138da9-762a-4796-a9b5-c2ca3945d862 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state building and task_state spawning.
Aug 16 09:06:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:06:51 user nova-compute[73208]: WARNING nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state building and task_state spawning.
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] No waiting events found dispatching network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:06:51 user nova-compute[73208]: WARNING nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received unexpected event network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c for instance with vm_state building and task_state spawning.
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] No waiting events found dispatching network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:06:51 user nova-compute[73208]: WARNING nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received unexpected event network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c for instance with vm_state building and task_state spawning.
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received event network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] No waiting events found dispatching network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:06:51 user nova-compute[73208]: WARNING nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received unexpected event network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f for instance with vm_state building and task_state spawning.
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received event network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] No waiting events found dispatching network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:06:51 user nova-compute[73208]: WARNING nova.compute.manager [req-49774d36-c1ab-4651-a3fb-f852e1868d5d req-70d2cf69-8452-472f-b96a-fe5c22bc8700 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received unexpected event network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f for instance with vm_state building and task_state spawning.
Aug 16 09:06:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:06:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:52 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176812.9284518, beb4ea79-b782-4540-8814-09b15002b432 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:52 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Resumed (Lifecycle Event)
Aug 16 09:06:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:06:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:06:52 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:06:52 user nova-compute[73208]: INFO nova.compute.claims [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Claim successful on node user
Aug 16 09:06:52 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance spawned successfully.
Aug 16 09:06:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176812.9353015, beb4ea79-b782-4540-8814-09b15002b432 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Started (Lifecycle Event)
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Instance spawned successfully.
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176813.133, ee15c9d4-1895-4afa-bd25-d21098b0ca34 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] VM Resumed (Lifecycle Event)
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Took 17.91 seconds to spawn the instance on the hypervisor.
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176813.1337872, ee15c9d4-1895-4afa-bd25-d21098b0ca34 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] VM Started (Lifecycle Event)
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Took 21.06 seconds to spawn the instance on the hypervisor.
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Took 18.87 seconds to build instance.
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.compute.manager [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Took 22.15 seconds to build instance.
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8cd95fbf-18a1-4a98-a5b8-6c863d7bf6d2 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.019s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e503359d-48b0-44e4-a460-88df148ca8d4 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.362s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.940s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:06:53 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 09:06:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176814.070682, aeff110f-8cbd-480d-8654-b0daee121eb7 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] VM Resumed (Lifecycle Event)
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Instance spawned successfully.
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.policy [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd651256cbca74403b5d1b4f574dcaa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afa4095799f45b98e936186595269f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176814.073108, aeff110f-8cbd-480d-8654-b0daee121eb7 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] VM Started (Lifecycle Event)
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance spawned successfully.
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Creating image(s)
Aug 16 09:06:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "/opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "/opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "/opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "71d4ca6cbb22b057ac5ca8490922724758c7965f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "71d4ca6cbb22b057ac5ca8490922724758c7965f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176814.2719424, 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] VM Resumed (Lifecycle Event)
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Took 20.90 seconds to spawn the instance on the hypervisor.
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:54 user nova-compute[73208]: INFO nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Took 21.85 seconds to spawn the instance on the hypervisor.
Aug 16 09:06:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176814.2753422, 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] VM Started (Lifecycle Event)
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Took 23.57 seconds to build instance.
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance spawned successfully.
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Took 22.64 seconds to build instance.
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-787be6f6-6042-4d0d-99fb-22368a0c0ab6 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.836s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6926737a-9f9e-4083-b692-678969ebc10a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.817s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176814.6017983, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Resumed (Lifecycle Event)
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f.part --force-share --output=json" returned: 0 in 0.236s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.images [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] c7ee566b-9a64-4316-bbe3-f1d6302a83a5 was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f.part /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Took 16.65 seconds to spawn the instance on the hypervisor.
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176814.6031961, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Started (Lifecycle Event)
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f.part /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f.converted" returned: 0 in 0.345s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:55 user nova-compute[73208]: INFO nova.compute.manager [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Took 18.03 seconds to build instance.
Aug 16 09:06:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b09bbb94-8ff4-4d63-9247-2b26632f350e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.205s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f.converted --force-share --output=json" returned: 0 in 0.328s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "71d4ca6cbb22b057ac5ca8490922724758c7965f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.572s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Successfully created port: d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f --force-share --output=json" returned: 0 in 0.346s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "71d4ca6cbb22b057ac5ca8490922724758c7965f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "71d4ca6cbb22b057ac5ca8490922724758c7965f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f --force-share --output=json" returned: 0 in 0.254s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f,backing_fmt=raw /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f,backing_fmt=raw /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk 1073741824" returned: 0 in 0.066s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "71d4ca6cbb22b057ac5ca8490922724758c7965f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f --force-share --output=json" returned: 0 in 0.365s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Cannot resize image /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lazy-loading 'migration_context' on Instance uuid 84819dea-4fd7-44cd-83a1-10e62263edca {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Ensure instance console log exists: /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Successfully updated port: d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquired lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-f3322850-7aef-4a1c-9ad5-a6675c487ccf req-f8c424e3-3fec-41c2-a585-a92a1c30d36b service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received event network-changed-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-f3322850-7aef-4a1c-9ad5-a6675c487ccf req-f8c424e3-3fec-41c2-a585-a92a1c30d36b service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Refreshing instance network info cache due to event network-changed-d6f60e94-e3b7-45e1-a723-fb9c7250902e. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f3322850-7aef-4a1c-9ad5-a6675c487ccf req-f8c424e3-3fec-41c2-a585-a92a1c30d36b service nova] Acquiring lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:06:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Updating instance_info_cache with network_info: [{"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Releasing lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Instance network_info: |[{"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f3322850-7aef-4a1c-9ad5-a6675c487ccf req-f8c424e3-3fec-41c2-a585-a92a1c30d36b service nova] Acquired lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.network.neutron [req-f3322850-7aef-4a1c-9ad5-a6675c487ccf req-f8c424e3-3fec-41c2-a585-a92a1c30d36b service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Refreshing network info cache for port d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Start _get_guest_xml network_info=[{"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:06:45Z,direct_url=<?>,disk_format='qcow2',id=c7ee566b-9a64-4316-bbe3-f1d6302a83a5,min_disk=0,min_ram=0,name='',owner='52d7a051cfeb4420b245854995264cd0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:06:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'device_name': '/dev/sda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': 'c7ee566b-9a64-4316-bbe3-f1d6302a83a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:58 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:58 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:06:45Z,direct_url=<?>,disk_format='qcow2',id=c7ee566b-9a64-4316-bbe3-f1d6302a83a5,min_disk=0,min_ram=0,name='',owner='52d7a051cfeb4420b245854995264cd0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:06:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-684298365',display_name='tempest-AttachSCSIVolumeTestJSON-server-684298365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-684298365',id=6,image_ref='c7ee566b-9a64-4316-bbe3-f1d6302a83a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKPO6IsESor397ravis1ugTUcdyYDMePBP+m2noJjgi4v3NKDS+RHPFzxlXvKbkhX7vSJvJb1XKDRphvIu7rmhKrKfhFscTcr4YDLcHWbCaY9ZfpBte/htkouJL3QEF3A==',key_name='tempest-keypair-1532475214',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7afa4095799f45b98e936186595269f4',ramdisk_id='',reservation_id='r-0s1qcm5j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ee566b-9a64-4316-bbe3-f1d6302a83a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1469266961',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1469266961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d651256cbca74403b5d1b4f574dcaa16',uuid=84819dea-4fd7-44cd-83a1-10e62263edca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Converting VIF {"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:93:b1,bridge_name='br-int',has_traffic_filtering=True,id=d6f60e94-e3b7-45e1-a723-fb9c7250902e,network=Network(ac955168-4318-4cc2-b694-0c0b36b96667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f60e94-e3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lazy-loading 'pci_devices' on Instance uuid 84819dea-4fd7-44cd-83a1-10e62263edca {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:06:58 user nova-compute[73208]:   <uuid>84819dea-4fd7-44cd-83a1-10e62263edca</uuid>
Aug 16 09:06:58 user nova-compute[73208]:   <name>instance-00000006</name>
Aug 16 09:06:58 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:06:58 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:06:58 user nova-compute[73208]:   <metadata>
Aug 16 09:06:58 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:06:58 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:06:58 user nova-compute[73208]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-684298365</nova:name>
Aug 16 09:06:58 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:06:58</nova:creationTime>
Aug 16 09:06:58 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:06:58 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:06:58 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:06:58 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:06:58 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:06:58 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:06:58 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:06:58 user nova-compute[73208]:       <nova:owner>
Aug 16 09:06:58 user nova-compute[73208]:         <nova:user uuid="d651256cbca74403b5d1b4f574dcaa16">tempest-AttachSCSIVolumeTestJSON-1469266961-project-member</nova:user>
Aug 16 09:06:58 user nova-compute[73208]:         <nova:project uuid="7afa4095799f45b98e936186595269f4">tempest-AttachSCSIVolumeTestJSON-1469266961</nova:project>
Aug 16 09:06:58 user nova-compute[73208]:       </nova:owner>
Aug 16 09:06:58 user nova-compute[73208]:       <nova:root type="image" uuid="c7ee566b-9a64-4316-bbe3-f1d6302a83a5"/>
Aug 16 09:06:58 user nova-compute[73208]:       <nova:ports>
Aug 16 09:06:58 user nova-compute[73208]:         <nova:port uuid="d6f60e94-e3b7-45e1-a723-fb9c7250902e">
Aug 16 09:06:58 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 09:06:58 user nova-compute[73208]:         </nova:port>
Aug 16 09:06:58 user nova-compute[73208]:       </nova:ports>
Aug 16 09:06:58 user nova-compute[73208]:     </nova:instance>
Aug 16 09:06:58 user nova-compute[73208]:   </metadata>
Aug 16 09:06:58 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:06:58 user nova-compute[73208]:     <system>
Aug 16 09:06:58 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:06:58 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:06:58 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:06:58 user nova-compute[73208]:       <entry name="serial">84819dea-4fd7-44cd-83a1-10e62263edca</entry>
Aug 16 09:06:58 user nova-compute[73208]:       <entry name="uuid">84819dea-4fd7-44cd-83a1-10e62263edca</entry>
Aug 16 09:06:58 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:06:58 user nova-compute[73208]:     </system>
Aug 16 09:06:58 user nova-compute[73208]:   </sysinfo>
Aug 16 09:06:58 user nova-compute[73208]:   <os>
Aug 16 09:06:58 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:06:58 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:06:58 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:06:58 user nova-compute[73208]:   </os>
Aug 16 09:06:58 user nova-compute[73208]:   <features>
Aug 16 09:06:58 user nova-compute[73208]:     <acpi/>
Aug 16 09:06:58 user nova-compute[73208]:     <apic/>
Aug 16 09:06:58 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:06:58 user nova-compute[73208]:   </features>
Aug 16 09:06:58 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:06:58 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:06:58 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:06:58 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:06:58 user nova-compute[73208]:   </clock>
Aug 16 09:06:58 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:06:58 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:06:58 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:06:58 user nova-compute[73208]:   </cpu>
Aug 16 09:06:58 user nova-compute[73208]:   <devices>
Aug 16 09:06:58 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:06:58 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:06:58 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk"/>
Aug 16 09:06:58 user nova-compute[73208]:       <target dev="sda" bus="scsi"/>
Aug 16 09:06:58 user nova-compute[73208]:       <address type="drive" controller="0" unit="0"/>
Aug 16 09:06:58 user nova-compute[73208]:     </disk>
Aug 16 09:06:58 user nova-compute[73208]:     <disk type="file" device="cdrom">
Aug 16 09:06:58 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 09:06:58 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk.config"/>
Aug 16 09:06:58 user nova-compute[73208]:       <target dev="sdb" bus="scsi"/>
Aug 16 09:06:58 user nova-compute[73208]:       <address type="drive" controller="0" unit="1"/>
Aug 16 09:06:58 user nova-compute[73208]:     </disk>
Aug 16 09:06:58 user nova-compute[73208]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 09:06:58 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:06:58 user nova-compute[73208]:       <mac address="fa:16:3e:80:93:b1"/>
Aug 16 09:06:58 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:58 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:06:58 user nova-compute[73208]:       <target dev="tapd6f60e94-e3"/>
Aug 16 09:06:58 user nova-compute[73208]:     </interface>
Aug 16 09:06:58 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:06:58 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/console.log" append="off"/>
Aug 16 09:06:58 user nova-compute[73208]:     </serial>
Aug 16 09:06:58 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:06:58 user nova-compute[73208]:     <video>
Aug 16 09:06:58 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:06:58 user nova-compute[73208]:     </video>
Aug 16 09:06:58 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:06:58 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:06:58 user nova-compute[73208]:     </rng>
Aug 16 09:06:58 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:06:58 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:06:58 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:06:58 user nova-compute[73208]:     </memballoon>
Aug 16 09:06:58 user nova-compute[73208]:   </devices>
Aug 16 09:06:58 user nova-compute[73208]: </domain>
Aug 16 09:06:58 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-684298365',display_name='tempest-AttachSCSIVolumeTestJSON-server-684298365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-684298365',id=6,image_ref='c7ee566b-9a64-4316-bbe3-f1d6302a83a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKPO6IsESor397ravis1ugTUcdyYDMePBP+m2noJjgi4v3NKDS+RHPFzxlXvKbkhX7vSJvJb1XKDRphvIu7rmhKrKfhFscTcr4YDLcHWbCaY9ZfpBte/htkouJL3QEF3A==',key_name='tempest-keypair-1532475214',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7afa4095799f45b98e936186595269f4',ramdisk_id='',reservation_id='r-0s1qcm5j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ee566b-9a64-4316-bbe3-f1d6302a83a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1469266961',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1469266961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d651256cbca74403b5d1b4f574dcaa16',uuid=84819dea-4fd7-44cd-83a1-10e62263edca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Converting VIF {"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:93:b1,bridge_name='br-int',has_traffic_filtering=True,id=d6f60e94-e3b7-45e1-a723-fb9c7250902e,network=Network(ac955168-4318-4cc2-b694-0c0b36b96667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f60e94-e3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG os_vif [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:93:b1,bridge_name='br-int',has_traffic_filtering=True,id=d6f60e94-e3b7-45e1-a723-fb9c7250902e,network=Network(ac955168-4318-4cc2-b694-0c0b36b96667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f60e94-e3') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6f60e94-e3, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6f60e94-e3, col_values=(('external_ids', {'iface-id': 'd6f60e94-e3b7-45e1-a723-fb9c7250902e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:93:b1', 'vm-uuid': '84819dea-4fd7-44cd-83a1-10e62263edca'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:58 user nova-compute[73208]: INFO os_vif [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:93:b1,bridge_name='br-int',has_traffic_filtering=True,id=d6f60e94-e3b7-45e1-a723-fb9c7250902e,network=Network(ac955168-4318-4cc2-b694-0c0b36b96667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f60e94-e3')
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] No BDM found with device name sda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:06:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] No VIF found with MAC fa:16:3e:80:93:b1, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:06:58 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Using config drive
Aug 16 09:06:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:06:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Creating config drive at /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk.config
Aug 16 09:07:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_3ruwm6o {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_3ruwm6o" returned: 0 in 0.097s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-f3322850-7aef-4a1c-9ad5-a6675c487ccf req-f8c424e3-3fec-41c2-a585-a92a1c30d36b service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Updated VIF entry in instance network info cache for port d6f60e94-e3b7-45e1-a723-fb9c7250902e. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-f3322850-7aef-4a1c-9ad5-a6675c487ccf req-f8c424e3-3fec-41c2-a585-a92a1c30d36b service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Updating instance_info_cache with network_info: [{"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f3322850-7aef-4a1c-9ad5-a6675c487ccf req-f8c424e3-3fec-41c2-a585-a92a1c30d36b service nova] Releasing lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:01 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:07:01 user nova-compute[73208]: INFO nova.compute.claims [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Claim successful on node user
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.281s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:07:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.policy [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47c19f8b4a714169ba98d35d751dafd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a0d6bce9943868579b6b88a526f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:07:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Creating image(s)
Aug 16 09:07:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.343s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.315s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:07:03 user nova-compute[73208]: INFO nova.compute.claims [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Claim successful on node user
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk 1073741824" returned: 0 in 0.130s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.453s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.322s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Successfully created port: 19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Cannot resize image /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.objects.instance [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'migration_context' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Ensure instance console log exists: /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.752s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:07:04 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.policy [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d2274361da342cdb881b2721d45d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3a2cc196d34f7cb74536a37f78f69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:07:04 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Creating image(s)
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "/opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "/opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "/opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.246s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.228s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk 1073741824" returned: 0 in 0.086s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Successfully updated port: 19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquired lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.334s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-4cfe31cb-3dce-42a3-8218-ea00539b46f6 req-3b9766a5-0e7d-4782-87dc-3fb6a5862006 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-changed-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-4cfe31cb-3dce-42a3-8218-ea00539b46f6 req-3b9766a5-0e7d-4782-87dc-3fb6a5862006 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Refreshing instance network info cache due to event network-changed-19a387ca-2e14-4170-947a-5f2b5f1f9bf1. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4cfe31cb-3dce-42a3-8218-ea00539b46f6 req-3b9766a5-0e7d-4782-87dc-3fb6a5862006 service nova] Acquiring lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176825.8397064, 84819dea-4fd7-44cd-83a1-10e62263edca => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:07:05 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] VM Resumed (Lifecycle Event)
Aug 16 09:07:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Instance spawned successfully.
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:07:05 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:07:05 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176825.8401203, 84819dea-4fd7-44cd-83a1-10e62263edca => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:07:05 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] VM Started (Lifecycle Event)
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:07:06 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:07:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.414s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Cannot resize image /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.objects.instance [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lazy-loading 'migration_context' on Instance uuid 77d077df-579d-4d9d-b76b-14d5d0a0d26f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:07:06 user nova-compute[73208]: INFO nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Took 11.80 seconds to spawn the instance on the hypervisor.
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Ensure instance console log exists: /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:06 user nova-compute[73208]: INFO nova.compute.manager [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Took 13.57 seconds to build instance.
Aug 16 09:07:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3ac8a809-70b0-494b-8a5b-ff7f14bd76f7 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.804s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.network.neutron [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Successfully created port: d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Releasing lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Instance network_info: |[{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4cfe31cb-3dce-42a3-8218-ea00539b46f6 req-3b9766a5-0e7d-4782-87dc-3fb6a5862006 service nova] Acquired lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.network.neutron [req-4cfe31cb-3dce-42a3-8218-ea00539b46f6 req-3b9766a5-0e7d-4782-87dc-3fb6a5862006 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Refreshing network info cache for port 19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Start _get_guest_xml network_info=[{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:07:06 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:06 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converting VIF {"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=19a387ca-2e14-4170-947a-5f2b5f1f9bf1,network=Network(3615971c-83be-448d-8c2e-d333a6e6f9f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a387ca-2e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:07:06 user nova-compute[73208]: DEBUG nova.objects.instance [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'pci_devices' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:07:07 user nova-compute[73208]:   <uuid>341d90a7-086a-42ce-9c23-d3422883d13e</uuid>
Aug 16 09:07:07 user nova-compute[73208]:   <name>instance-00000007</name>
Aug 16 09:07:07 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:07:07 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:07:07 user nova-compute[73208]:   <metadata>
Aug 16 09:07:07 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:07:07 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:07:07 user nova-compute[73208]:       <nova:name>tempest-device-tagging-server-618417393</nova:name>
Aug 16 09:07:07 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:07:06</nova:creationTime>
Aug 16 09:07:07 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:07:07 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:07:07 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:07:07 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:07:07 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:07:07 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:07:07 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:07:07 user nova-compute[73208]:       <nova:owner>
Aug 16 09:07:07 user nova-compute[73208]:         <nova:user uuid="47c19f8b4a714169ba98d35d751dafd7">tempest-TaggedAttachmentsTest-2091015158-project-member</nova:user>
Aug 16 09:07:07 user nova-compute[73208]:         <nova:project uuid="293a0d6bce9943868579b6b88a526f2b">tempest-TaggedAttachmentsTest-2091015158</nova:project>
Aug 16 09:07:07 user nova-compute[73208]:       </nova:owner>
Aug 16 09:07:07 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:07:07 user nova-compute[73208]:       <nova:ports>
Aug 16 09:07:07 user nova-compute[73208]:         <nova:port uuid="19a387ca-2e14-4170-947a-5f2b5f1f9bf1">
Aug 16 09:07:07 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:07:07 user nova-compute[73208]:         </nova:port>
Aug 16 09:07:07 user nova-compute[73208]:       </nova:ports>
Aug 16 09:07:07 user nova-compute[73208]:     </nova:instance>
Aug 16 09:07:07 user nova-compute[73208]:   </metadata>
Aug 16 09:07:07 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:07:07 user nova-compute[73208]:     <system>
Aug 16 09:07:07 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:07:07 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:07:07 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:07:07 user nova-compute[73208]:       <entry name="serial">341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:07:07 user nova-compute[73208]:       <entry name="uuid">341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:07:07 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:07:07 user nova-compute[73208]:     </system>
Aug 16 09:07:07 user nova-compute[73208]:   </sysinfo>
Aug 16 09:07:07 user nova-compute[73208]:   <os>
Aug 16 09:07:07 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:07:07 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:07:07 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:07:07 user nova-compute[73208]:   </os>
Aug 16 09:07:07 user nova-compute[73208]:   <features>
Aug 16 09:07:07 user nova-compute[73208]:     <acpi/>
Aug 16 09:07:07 user nova-compute[73208]:     <apic/>
Aug 16 09:07:07 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:07:07 user nova-compute[73208]:   </features>
Aug 16 09:07:07 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:07:07 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:07:07 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:07:07 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:07:07 user nova-compute[73208]:   </clock>
Aug 16 09:07:07 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:07:07 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:07:07 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:07:07 user nova-compute[73208]:   </cpu>
Aug 16 09:07:07 user nova-compute[73208]:   <devices>
Aug 16 09:07:07 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:07:07 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:07:07 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk"/>
Aug 16 09:07:07 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:07:07 user nova-compute[73208]:     </disk>
Aug 16 09:07:07 user nova-compute[73208]:     <disk type="file" device="cdrom">
Aug 16 09:07:07 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 09:07:07 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.config"/>
Aug 16 09:07:07 user nova-compute[73208]:       <target dev="hda" bus="ide"/>
Aug 16 09:07:07 user nova-compute[73208]:     </disk>
Aug 16 09:07:07 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:07:07 user nova-compute[73208]:       <mac address="fa:16:3e:c2:f8:7f"/>
Aug 16 09:07:07 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:07:07 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:07:07 user nova-compute[73208]:       <target dev="tap19a387ca-2e"/>
Aug 16 09:07:07 user nova-compute[73208]:     </interface>
Aug 16 09:07:07 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:07:07 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log" append="off"/>
Aug 16 09:07:07 user nova-compute[73208]:     </serial>
Aug 16 09:07:07 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:07:07 user nova-compute[73208]:     <video>
Aug 16 09:07:07 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:07:07 user nova-compute[73208]:     </video>
Aug 16 09:07:07 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:07:07 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:07:07 user nova-compute[73208]:     </rng>
Aug 16 09:07:07 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:07:07 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:07:07 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:07:07 user nova-compute[73208]:     </memballoon>
Aug 16 09:07:07 user nova-compute[73208]:   </devices>
Aug 16 09:07:07 user nova-compute[73208]: </domain>
Aug 16 09:07:07 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converting VIF {"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=19a387ca-2e14-4170-947a-5f2b5f1f9bf1,network=Network(3615971c-83be-448d-8c2e-d333a6e6f9f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a387ca-2e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG os_vif [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=19a387ca-2e14-4170-947a-5f2b5f1f9bf1,network=Network(3615971c-83be-448d-8c2e-d333a6e6f9f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a387ca-2e') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19a387ca-2e, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19a387ca-2e, col_values=(('external_ids', {'iface-id': '19a387ca-2e14-4170-947a-5f2b5f1f9bf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:f8:7f', 'vm-uuid': '341d90a7-086a-42ce-9c23-d3422883d13e'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:07 user nova-compute[73208]: INFO os_vif [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=19a387ca-2e14-4170-947a-5f2b5f1f9bf1,network=Network(3615971c-83be-448d-8c2e-d333a6e6f9f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a387ca-2e')
Aug 16 09:07:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No BDM found with device name hda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No VIF found with MAC fa:16:3e:c2:f8:7f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:07:07 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Using config drive
Aug 16 09:07:07 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Creating config drive at /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.config
Aug 16 09:07:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4gt4_1r8 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4gt4_1r8" returned: 0 in 0.113s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-4ace9fab-04d0-4fb1-a101-326d15360b8d req-f3839d4b-4df2-46ce-8078-1ead8b3abf70 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4ace9fab-04d0-4fb1-a101-326d15360b8d req-f3839d4b-4df2-46ce-8078-1ead8b3abf70 service nova] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4ace9fab-04d0-4fb1-a101-326d15360b8d req-f3839d4b-4df2-46ce-8078-1ead8b3abf70 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4ace9fab-04d0-4fb1-a101-326d15360b8d req-f3839d4b-4df2-46ce-8078-1ead8b3abf70 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-4ace9fab-04d0-4fb1-a101-326d15360b8d req-f3839d4b-4df2-46ce-8078-1ead8b3abf70 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] No waiting events found dispatching network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:08 user nova-compute[73208]: WARNING nova.compute.manager [req-4ace9fab-04d0-4fb1-a101-326d15360b8d req-f3839d4b-4df2-46ce-8078-1ead8b3abf70 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received unexpected event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 for instance with vm_state active and task_state None.
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-4cfe31cb-3dce-42a3-8218-ea00539b46f6 req-3b9766a5-0e7d-4782-87dc-3fb6a5862006 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updated VIF entry in instance network info cache for port 19a387ca-2e14-4170-947a-5f2b5f1f9bf1. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-4cfe31cb-3dce-42a3-8218-ea00539b46f6 req-3b9766a5-0e7d-4782-87dc-3fb6a5862006 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4cfe31cb-3dce-42a3-8218-ea00539b46f6 req-3b9766a5-0e7d-4782-87dc-3fb6a5862006 service nova] Releasing lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.network.neutron [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Successfully updated port: d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquired lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.network.neutron [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.network.neutron [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-e72d2566-e21c-4490-9b31-a9527258ff89 req-f9e445db-4600-42ae-99bb-9f43f93190be service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received event network-changed-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-e72d2566-e21c-4490-9b31-a9527258ff89 req-f9e445db-4600-42ae-99bb-9f43f93190be service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Refreshing instance network info cache due to event network-changed-d5f33513-9c06-4d4c-80ae-96d56600b971. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e72d2566-e21c-4490-9b31-a9527258ff89 req-f9e445db-4600-42ae-99bb-9f43f93190be service nova] Acquiring lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.network.neutron [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Updating instance_info_cache with network_info: [{"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Releasing lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Instance network_info: |[{"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e72d2566-e21c-4490-9b31-a9527258ff89 req-f9e445db-4600-42ae-99bb-9f43f93190be service nova] Acquired lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.network.neutron [req-e72d2566-e21c-4490-9b31-a9527258ff89 req-f9e445db-4600-42ae-99bb-9f43f93190be service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Refreshing network info cache for port d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Start _get_guest_xml network_info=[{"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:07:09 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:09 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2019339522',display_name='tempest-VolumesAssistedSnapshotsTest-server-2019339522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2019339522',id=8,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmvT+9+EUPxAUKZAkHd65XMwZqcFdTUEdTrTInLHh3mgSkt45KZLVseP8SrbbN35VL7IRGiXzyfHRGqcrvfynjD2SMKY7u454v0hbe/w2npFAbAMS5U+GCHo9wYVFR4HQ==',key_name='tempest-keypair-1694979867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb3a2cc196d34f7cb74536a37f78f69c',ramdisk_id='',reservation_id='r-yusrxhdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998796937',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998796937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2274361da342cdb881b2721d45d715',uuid=77d077df-579d-4d9d-b76b-14d5d0a0d26f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Converting VIF {"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4b:16,bridge_name='br-int',has_traffic_filtering=True,id=d5f33513-9c06-4d4c-80ae-96d56600b971,network=Network(3ad6a26f-5346-4047-9c3d-3d119de2ab51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f33513-9c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.objects.instance [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lazy-loading 'pci_devices' on Instance uuid 77d077df-579d-4d9d-b76b-14d5d0a0d26f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:07:09 user nova-compute[73208]:   <uuid>77d077df-579d-4d9d-b76b-14d5d0a0d26f</uuid>
Aug 16 09:07:09 user nova-compute[73208]:   <name>instance-00000008</name>
Aug 16 09:07:09 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:07:09 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:07:09 user nova-compute[73208]:   <metadata>
Aug 16 09:07:09 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:07:09 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:07:09 user nova-compute[73208]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2019339522</nova:name>
Aug 16 09:07:09 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:07:09</nova:creationTime>
Aug 16 09:07:09 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:07:09 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:07:09 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:07:09 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:07:09 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:07:09 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:07:09 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:07:09 user nova-compute[73208]:       <nova:owner>
Aug 16 09:07:09 user nova-compute[73208]:         <nova:user uuid="0d2274361da342cdb881b2721d45d715">tempest-VolumesAssistedSnapshotsTest-998796937-project-member</nova:user>
Aug 16 09:07:09 user nova-compute[73208]:         <nova:project uuid="cb3a2cc196d34f7cb74536a37f78f69c">tempest-VolumesAssistedSnapshotsTest-998796937</nova:project>
Aug 16 09:07:09 user nova-compute[73208]:       </nova:owner>
Aug 16 09:07:09 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:07:09 user nova-compute[73208]:       <nova:ports>
Aug 16 09:07:09 user nova-compute[73208]:         <nova:port uuid="d5f33513-9c06-4d4c-80ae-96d56600b971">
Aug 16 09:07:09 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 09:07:09 user nova-compute[73208]:         </nova:port>
Aug 16 09:07:09 user nova-compute[73208]:       </nova:ports>
Aug 16 09:07:09 user nova-compute[73208]:     </nova:instance>
Aug 16 09:07:09 user nova-compute[73208]:   </metadata>
Aug 16 09:07:09 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:07:09 user nova-compute[73208]:     <system>
Aug 16 09:07:09 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:07:09 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:07:09 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:07:09 user nova-compute[73208]:       <entry name="serial">77d077df-579d-4d9d-b76b-14d5d0a0d26f</entry>
Aug 16 09:07:09 user nova-compute[73208]:       <entry name="uuid">77d077df-579d-4d9d-b76b-14d5d0a0d26f</entry>
Aug 16 09:07:09 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:07:09 user nova-compute[73208]:     </system>
Aug 16 09:07:09 user nova-compute[73208]:   </sysinfo>
Aug 16 09:07:09 user nova-compute[73208]:   <os>
Aug 16 09:07:09 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:07:09 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:07:09 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:07:09 user nova-compute[73208]:   </os>
Aug 16 09:07:09 user nova-compute[73208]:   <features>
Aug 16 09:07:09 user nova-compute[73208]:     <acpi/>
Aug 16 09:07:09 user nova-compute[73208]:     <apic/>
Aug 16 09:07:09 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:07:09 user nova-compute[73208]:   </features>
Aug 16 09:07:09 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:07:09 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:07:09 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:07:09 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:07:09 user nova-compute[73208]:   </clock>
Aug 16 09:07:09 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:07:09 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:07:09 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:07:09 user nova-compute[73208]:   </cpu>
Aug 16 09:07:09 user nova-compute[73208]:   <devices>
Aug 16 09:07:09 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:07:09 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:07:09 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk"/>
Aug 16 09:07:09 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:07:09 user nova-compute[73208]:     </disk>
Aug 16 09:07:09 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:07:09 user nova-compute[73208]:       <mac address="fa:16:3e:8b:4b:16"/>
Aug 16 09:07:09 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:07:09 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:07:09 user nova-compute[73208]:       <target dev="tapd5f33513-9c"/>
Aug 16 09:07:09 user nova-compute[73208]:     </interface>
Aug 16 09:07:09 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:07:09 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/console.log" append="off"/>
Aug 16 09:07:09 user nova-compute[73208]:     </serial>
Aug 16 09:07:09 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:07:09 user nova-compute[73208]:     <video>
Aug 16 09:07:09 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:07:09 user nova-compute[73208]:     </video>
Aug 16 09:07:09 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:07:09 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:07:09 user nova-compute[73208]:     </rng>
Aug 16 09:07:09 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:07:09 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:07:09 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:07:09 user nova-compute[73208]:     </memballoon>
Aug 16 09:07:09 user nova-compute[73208]:   </devices>
Aug 16 09:07:09 user nova-compute[73208]: </domain>
Aug 16 09:07:09 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2019339522',display_name='tempest-VolumesAssistedSnapshotsTest-server-2019339522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2019339522',id=8,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmvT+9+EUPxAUKZAkHd65XMwZqcFdTUEdTrTInLHh3mgSkt45KZLVseP8SrbbN35VL7IRGiXzyfHRGqcrvfynjD2SMKY7u454v0hbe/w2npFAbAMS5U+GCHo9wYVFR4HQ==',key_name='tempest-keypair-1694979867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb3a2cc196d34f7cb74536a37f78f69c',ramdisk_id='',reservation_id='r-yusrxhdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998796937',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998796937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2274361da342cdb881b2721d45d715',uuid=77d077df-579d-4d9d-b76b-14d5d0a0d26f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Converting VIF {"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4b:16,bridge_name='br-int',has_traffic_filtering=True,id=d5f33513-9c06-4d4c-80ae-96d56600b971,network=Network(3ad6a26f-5346-4047-9c3d-3d119de2ab51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f33513-9c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG os_vif [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4b:16,bridge_name='br-int',has_traffic_filtering=True,id=d5f33513-9c06-4d4c-80ae-96d56600b971,network=Network(3ad6a26f-5346-4047-9c3d-3d119de2ab51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f33513-9c') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5f33513-9c, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5f33513-9c, col_values=(('external_ids', {'iface-id': 'd5f33513-9c06-4d4c-80ae-96d56600b971', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:4b:16', 'vm-uuid': '77d077df-579d-4d9d-b76b-14d5d0a0d26f'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: INFO os_vif [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4b:16,bridge_name='br-int',has_traffic_filtering=True,id=d5f33513-9c06-4d4c-80ae-96d56600b971,network=Network(3ad6a26f-5346-4047-9c3d-3d119de2ab51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f33513-9c')
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:07:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] No VIF found with MAC fa:16:3e:8b:4b:16, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-e72d2566-e21c-4490-9b31-a9527258ff89 req-f9e445db-4600-42ae-99bb-9f43f93190be service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Updated VIF entry in instance network info cache for port d5f33513-9c06-4d4c-80ae-96d56600b971. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-e72d2566-e21c-4490-9b31-a9527258ff89 req-f9e445db-4600-42ae-99bb-9f43f93190be service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Updating instance_info_cache with network_info: [{"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e72d2566-e21c-4490-9b31-a9527258ff89 req-f9e445db-4600-42ae-99bb-9f43f93190be service nova] Releasing lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] No waiting events found dispatching network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:10 user nova-compute[73208]: WARNING nova.compute.manager [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received unexpected event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 for instance with vm_state active and task_state None.
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] No waiting events found dispatching network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:10 user nova-compute[73208]: WARNING nova.compute.manager [req-ba4e743e-b3e5-493b-980f-2e085b112a5f req-f94851af-23a4-478a-b251-a2dd4480638f service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received unexpected event network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 for instance with vm_state building and task_state spawning.
Aug 16 09:07:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:07:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] No waiting events found dispatching network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:12 user nova-compute[73208]: WARNING nova.compute.manager [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received unexpected event network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 for instance with vm_state building and task_state spawning.
Aug 16 09:07:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received event network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] No waiting events found dispatching network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:12 user nova-compute[73208]: WARNING nova.compute.manager [req-8cccef00-2b89-4562-ba5f-4223f3e2c831 req-208d0040-1d2c-4bda-9777-f0951b09c504 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received unexpected event network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 for instance with vm_state building and task_state spawning.
Aug 16 09:07:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Skipping network cache update for instance because it is Building. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Skipping network cache update for instance because it is Building. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176834.7784598, 341d90a7-086a-42ce-9c23-d3422883d13e => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:07:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] VM Resumed (Lifecycle Event)
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:07:14 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Instance spawned successfully.
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid ee15c9d4-1895-4afa-bd25-d21098b0ca34 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176834.7787244, 341d90a7-086a-42ce-9c23-d3422883d13e => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:07:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] VM Started (Lifecycle Event)
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:07:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:07:14 user nova-compute[73208]: INFO nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Took 12.09 seconds to spawn the instance on the hypervisor.
Aug 16 09:07:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-a6736377-520c-4830-82fd-910d797dba58 req-bf2d214a-2579-422f-93e5-4ef55f70eb1d service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received event network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a6736377-520c-4830-82fd-910d797dba58 req-bf2d214a-2579-422f-93e5-4ef55f70eb1d service nova] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a6736377-520c-4830-82fd-910d797dba58 req-bf2d214a-2579-422f-93e5-4ef55f70eb1d service nova] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a6736377-520c-4830-82fd-910d797dba58 req-bf2d214a-2579-422f-93e5-4ef55f70eb1d service nova] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-a6736377-520c-4830-82fd-910d797dba58 req-bf2d214a-2579-422f-93e5-4ef55f70eb1d service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] No waiting events found dispatching network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:15 user nova-compute[73208]: WARNING nova.compute.manager [req-a6736377-520c-4830-82fd-910d797dba58 req-bf2d214a-2579-422f-93e5-4ef55f70eb1d service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received unexpected event network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 for instance with vm_state building and task_state spawning.
Aug 16 09:07:15 user nova-compute[73208]: INFO nova.compute.manager [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Took 14.19 seconds to build instance.
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78552b93-09c0-44a3-9c98-80917255db52 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.371s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176835.185091, 77d077df-579d-4d9d-b76b-14d5d0a0d26f => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:07:15 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] VM Resumed (Lifecycle Event)
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:07:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Instance spawned successfully.
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:07:15 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176835.1876955, 77d077df-579d-4d9d-b76b-14d5d0a0d26f => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:07:15 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] VM Started (Lifecycle Event)
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:07:15 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:07:15 user nova-compute[73208]: INFO nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Took 10.60 seconds to spawn the instance on the hypervisor.
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:15 user nova-compute[73208]: INFO nova.compute.manager [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Took 11.93 seconds to build instance.
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1afe9f-db1d-40ae-8da6-595c49dc4cf9 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.166s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Updating instance_info_cache with network_info: [{"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-ee15c9d4-1895-4afa-bd25-d21098b0ca34" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-045bbace-8e63-4275-b21b-496e491cf9fe req-d52041b2-12b4-4009-88f7-9a293f19ad9e service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-045bbace-8e63-4275-b21b-496e491cf9fe req-d52041b2-12b4-4009-88f7-9a293f19ad9e service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-045bbace-8e63-4275-b21b-496e491cf9fe req-d52041b2-12b4-4009-88f7-9a293f19ad9e service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-045bbace-8e63-4275-b21b-496e491cf9fe req-d52041b2-12b4-4009-88f7-9a293f19ad9e service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-045bbace-8e63-4275-b21b-496e491cf9fe req-d52041b2-12b4-4009-88f7-9a293f19ad9e service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:15 user nova-compute[73208]: WARNING nova.compute.manager [req-045bbace-8e63-4275-b21b-496e491cf9fe req-d52041b2-12b4-4009-88f7-9a293f19ad9e service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state active and task_state None.
Aug 16 09:07:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:17 user nova-compute[73208]: WARNING nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state active and task_state None.
Aug 16 09:07:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received event network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] No waiting events found dispatching network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:17 user nova-compute[73208]: WARNING nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received unexpected event network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e for instance with vm_state active and task_state None.
Aug 16 09:07:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received event network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] No waiting events found dispatching network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:17 user nova-compute[73208]: WARNING nova.compute.manager [req-7072eafa-70b2-496f-8955-c8a1937b4e4f req-9ce1e62b-a551-4e5f-98d2-a8e56becfd95 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received unexpected event network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e for instance with vm_state active and task_state None.
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:20 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:20 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:20 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.888885498046875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:07:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ee15c9d4-1895-4afa-bd25-d21098b0ca34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 84819dea-4fd7-44cd-83a1-10e62263edca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 341d90a7-086a-42ce-9c23-d3422883d13e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:07:21 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:07:22 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:07:22 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:07:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:07:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.353s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:07:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "9b4f9560-9aae-4591-9037-c76c1504f170" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:07:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:07:24 user nova-compute[73208]: INFO nova.compute.claims [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Claim successful on node user
Aug 16 09:07:25 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:07:25 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:07:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:07:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:07:25 user nova-compute[73208]: DEBUG nova.network.neutron [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:07:25 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:07:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:07:25 user nova-compute[73208]: DEBUG nova.policy [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb4f290b3a9d41f0830720605ea7e601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e2b7d360dd490e92b4059046b5dbac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:07:25 user nova-compute[73208]: INFO nova.virt.block_device [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Booting with volume d37615d3-44d4-4152-8d90-d480a38c255d at /dev/vda
Aug 16 09:07:25 user nova-compute[73208]: DEBUG os_brick.utils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:07:25 user nova-compute[73208]: INFO oslo.privsep.daemon [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp4wfa3w85/privsep.sock']
Aug 16 09:07:25 user sudo[84050]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp4wfa3w85/privsep.sock
Aug 16 09:07:25 user sudo[84050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 09:07:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Successfully created port: 91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Successfully updated port: 91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquired lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG nova.network.neutron [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-9e5a6d62-7ffe-4a99-b3d2-06ae90f4ee79 req-0101fbfe-2bd0-42f9-9915-c853796b6ea4 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received event network-changed-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-9e5a6d62-7ffe-4a99-b3d2-06ae90f4ee79 req-0101fbfe-2bd0-42f9-9915-c853796b6ea4 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Refreshing instance network info cache due to event network-changed-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e5a6d62-7ffe-4a99-b3d2-06ae90f4ee79 req-0101fbfe-2bd0-42f9-9915-c853796b6ea4 service nova] Acquiring lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG nova.network.neutron [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG nova.network.neutron [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updating instance_info_cache with network_info: [{"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Releasing lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance network_info: |[{"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e5a6d62-7ffe-4a99-b3d2-06ae90f4ee79 req-0101fbfe-2bd0-42f9-9915-c853796b6ea4 service nova] Acquired lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG nova.network.neutron [req-9e5a6d62-7ffe-4a99-b3d2-06ae90f4ee79 req-0101fbfe-2bd0-42f9-9915-c853796b6ea4 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Refreshing network info cache for port 91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:07:27 user sudo[84050]: pam_unix(sudo:session): session closed for user root
Aug 16 09:07:27 user nova-compute[73208]: INFO oslo.privsep.daemon [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Spawned new privsep daemon via rootwrap
Aug 16 09:07:27 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 09:07:27 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 09:07:27 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 09:07:27 user nova-compute[73208]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84054
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe52d6c5-dc09-428d-9ad2-8ed5ba4b73e0]: (2,) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1f2599-7501-438d-8851-c83b86728d47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:27 user nova-compute[73208]: WARNING os_brick.initiator.connectors.nvmeof [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b300b654-0947-46e1-b3b5-0f4adcd2effe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ffa7b2-5fcc-4afd-aa01-2a593575708d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dbdace-6ae3-46dd-a827-c96602bddc83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:07:27 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:07:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b194d270-7444-4103-94f0-65bb77c9d78c]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG os_brick.utils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] <== get_connector_properties: return (2360ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:07:27 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updating existing volume attachment record: 08c4e945-48ff-4770-893c-8bd24a8fa4f6 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:07:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-9e5a6d62-7ffe-4a99-b3d2-06ae90f4ee79 req-0101fbfe-2bd0-42f9-9915-c853796b6ea4 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updated VIF entry in instance network info cache for port 91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:07:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-9e5a6d62-7ffe-4a99-b3d2-06ae90f4ee79 req-0101fbfe-2bd0-42f9-9915-c853796b6ea4 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updating instance_info_cache with network_info: [{"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e5a6d62-7ffe-4a99-b3d2-06ae90f4ee79 req-0101fbfe-2bd0-42f9-9915-c853796b6ea4 service nova] Releasing lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:07:38 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Creating image(s)
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Ensure instance console log exists: /opt/stack/data/nova/instances/9b4f9560-9aae-4591-9037-c76c1504f170/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Start _get_guest_xml network_info=[{"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '08c4e945-48ff-4770-893c-8bd24a8fa4f6', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoJpVtzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b4f9560-9aae-4591-9037-c76c1504f170', 'attached_at': '', 'detached_at': '', 'volume_id': 'd37615d3-44d4-4152-8d90-d480a38c255d', 'serial': 'd37615d3-44d4-4152-8d90-d480a38c255d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:07:38 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:38 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connector [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Factory for ISCSI on None {{(pid=73208) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoJpVtzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:07:38 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:07:38 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:07:38 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ab409e-85d7-43ba-b34f-464e62e51f42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:07:38 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e86a0-2e6b-4468-b5bb-39dd758cc41c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d] added
Aug 16 09:07:38 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c18b89-20ee-45c2-9195-aba94f575dee]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1c9e5a-5fca-4c5d-a860-a5bd12cf3a21]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoJpVtzZ {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoJpVtzZ" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8513fb21-456c-4894-af8f-1b5d1dc77d05]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoJpVtzZ'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb3b39f-7a03-40ef-8c42-bb53962950c8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aca84e-2d4d-4df1-9b1c-a18ceb7e912f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:07:38 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:07:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:07:38 user nova-compute[73208]:  {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:07:38 user nova-compute[73208]: WARNING os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 09:07:38 user nova-compute[73208]: 
Aug 16 09:07:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b079639b-1543-468f-ace9-cbd4b1587700]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d, portal: 172.16.0.220,3260]
Aug 16 09:07:39 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d, portal: 172.16.0.220,3260] successful.
Aug 16 09:07:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[195f8b34-2a36-42ad-a358-7c3b934b749f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c597d6e-da7b-4331-bf68-80dd72482126]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:07:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:07:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a6eeb4-15aa-4f64-b8d5-2ce2d0d35b6f]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoJpVtzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26631373137373438', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631373137373438', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2135176385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2135176385',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqVMHp97P9ublYenAcgiSOc9ytp+GzRvrXFO7o7iJo+WF+qpCY0zMqmhKHd0j/TNreM8QuEhFCVAjULrP8OMq5bCydKoV0CuzEeL7alWBhWv+5yB6zpO1Fk0vqcEP3NTA==',key_name='tempest-keypair-216633937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e2b7d360dd490e92b4059046b5dbac',ramdisk_id='',reservation_id='r-2rx0673y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-945797344',owner_user_name='tempest-ServerActionsV293TestJSON-945797344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb4f290b3a9d41f0830720605ea7e601',uuid=9b4f9560-9aae-4591-9037-c76c1504f170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Converting VIF {"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.objects.instance [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b4f9560-9aae-4591-9037-c76c1504f170 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:07:40 user nova-compute[73208]:   <uuid>9b4f9560-9aae-4591-9037-c76c1504f170</uuid>
Aug 16 09:07:40 user nova-compute[73208]:   <name>instance-00000009</name>
Aug 16 09:07:40 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:07:40 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:07:40 user nova-compute[73208]:   <metadata>
Aug 16 09:07:40 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:07:40 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:07:40 user nova-compute[73208]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2135176385</nova:name>
Aug 16 09:07:40 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:07:38</nova:creationTime>
Aug 16 09:07:40 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:07:40 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:07:40 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:07:40 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:07:40 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:07:40 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:07:40 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:07:40 user nova-compute[73208]:       <nova:owner>
Aug 16 09:07:40 user nova-compute[73208]:         <nova:user uuid="eb4f290b3a9d41f0830720605ea7e601">tempest-ServerActionsV293TestJSON-945797344-project-member</nova:user>
Aug 16 09:07:40 user nova-compute[73208]:         <nova:project uuid="e4e2b7d360dd490e92b4059046b5dbac">tempest-ServerActionsV293TestJSON-945797344</nova:project>
Aug 16 09:07:40 user nova-compute[73208]:       </nova:owner>
Aug 16 09:07:40 user nova-compute[73208]:       <nova:ports>
Aug 16 09:07:40 user nova-compute[73208]:         <nova:port uuid="91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4">
Aug 16 09:07:40 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 09:07:40 user nova-compute[73208]:         </nova:port>
Aug 16 09:07:40 user nova-compute[73208]:       </nova:ports>
Aug 16 09:07:40 user nova-compute[73208]:     </nova:instance>
Aug 16 09:07:40 user nova-compute[73208]:   </metadata>
Aug 16 09:07:40 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:07:40 user nova-compute[73208]:     <system>
Aug 16 09:07:40 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:07:40 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:07:40 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:07:40 user nova-compute[73208]:       <entry name="serial">9b4f9560-9aae-4591-9037-c76c1504f170</entry>
Aug 16 09:07:40 user nova-compute[73208]:       <entry name="uuid">9b4f9560-9aae-4591-9037-c76c1504f170</entry>
Aug 16 09:07:40 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:07:40 user nova-compute[73208]:     </system>
Aug 16 09:07:40 user nova-compute[73208]:   </sysinfo>
Aug 16 09:07:40 user nova-compute[73208]:   <os>
Aug 16 09:07:40 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:07:40 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:07:40 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:07:40 user nova-compute[73208]:   </os>
Aug 16 09:07:40 user nova-compute[73208]:   <features>
Aug 16 09:07:40 user nova-compute[73208]:     <acpi/>
Aug 16 09:07:40 user nova-compute[73208]:     <apic/>
Aug 16 09:07:40 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:07:40 user nova-compute[73208]:   </features>
Aug 16 09:07:40 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:07:40 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:07:40 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:07:40 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:07:40 user nova-compute[73208]:   </clock>
Aug 16 09:07:40 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:07:40 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:07:40 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:07:40 user nova-compute[73208]:   </cpu>
Aug 16 09:07:40 user nova-compute[73208]:   <devices>
Aug 16 09:07:40 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:07:40 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:07:40 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:07:40 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:07:40 user nova-compute[73208]:       <serial>d37615d3-44d4-4152-8d90-d480a38c255d</serial>
Aug 16 09:07:40 user nova-compute[73208]:     </disk>
Aug 16 09:07:40 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:07:40 user nova-compute[73208]:       <mac address="fa:16:3e:3b:09:45"/>
Aug 16 09:07:40 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:07:40 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:07:40 user nova-compute[73208]:       <target dev="tap91f4f751-4d"/>
Aug 16 09:07:40 user nova-compute[73208]:     </interface>
Aug 16 09:07:40 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:07:40 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/9b4f9560-9aae-4591-9037-c76c1504f170/console.log" append="off"/>
Aug 16 09:07:40 user nova-compute[73208]:     </serial>
Aug 16 09:07:40 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:07:40 user nova-compute[73208]:     <video>
Aug 16 09:07:40 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:07:40 user nova-compute[73208]:     </video>
Aug 16 09:07:40 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:07:40 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:07:40 user nova-compute[73208]:     </rng>
Aug 16 09:07:40 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:07:40 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:07:40 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:07:40 user nova-compute[73208]:     </memballoon>
Aug 16 09:07:40 user nova-compute[73208]:   </devices>
Aug 16 09:07:40 user nova-compute[73208]: </domain>
Aug 16 09:07:40 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2135176385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2135176385',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqVMHp97P9ublYenAcgiSOc9ytp+GzRvrXFO7o7iJo+WF+qpCY0zMqmhKHd0j/TNreM8QuEhFCVAjULrP8OMq5bCydKoV0CuzEeL7alWBhWv+5yB6zpO1Fk0vqcEP3NTA==',key_name='tempest-keypair-216633937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e2b7d360dd490e92b4059046b5dbac',ramdisk_id='',reservation_id='r-2rx0673y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-945797344',owner_user_name='tempest-ServerActionsV293TestJSON-945797344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb4f290b3a9d41f0830720605ea7e601',uuid=9b4f9560-9aae-4591-9037-c76c1504f170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Converting VIF {"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG os_vif [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91f4f751-4d, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91f4f751-4d, col_values=(('external_ids', {'iface-id': '91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:09:45', 'vm-uuid': '9b4f9560-9aae-4591-9037-c76c1504f170'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:40 user nova-compute[73208]: INFO os_vif [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d')
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:07:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] No VIF found with MAC fa:16:3e:3b:09:45, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:07:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-0af1c5d8-2dd0-42fd-a227-7009252b0d22 req-849dd27e-ef12-43cd-857a-7341a08aa0b3 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received event network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0af1c5d8-2dd0-42fd-a227-7009252b0d22 req-849dd27e-ef12-43cd-857a-7341a08aa0b3 service nova] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0af1c5d8-2dd0-42fd-a227-7009252b0d22 req-849dd27e-ef12-43cd-857a-7341a08aa0b3 service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0af1c5d8-2dd0-42fd-a227-7009252b0d22 req-849dd27e-ef12-43cd-857a-7341a08aa0b3 service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-0af1c5d8-2dd0-42fd-a227-7009252b0d22 req-849dd27e-ef12-43cd-857a-7341a08aa0b3 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] No waiting events found dispatching network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:42 user nova-compute[73208]: WARNING nova.compute.manager [req-0af1c5d8-2dd0-42fd-a227-7009252b0d22 req-849dd27e-ef12-43cd-857a-7341a08aa0b3 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received unexpected event network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 for instance with vm_state building and task_state spawning.
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176863.931363, 9b4f9560-9aae-4591-9037-c76c1504f170 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:07:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] VM Resumed (Lifecycle Event)
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:07:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance spawned successfully.
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:07:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:07:43 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176863.9330626, 9b4f9560-9aae-4591-9037-c76c1504f170 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:07:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] VM Started (Lifecycle Event)
Aug 16 09:07:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:07:44 user nova-compute[73208]: INFO nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 16 09:07:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:07:44 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:07:44 user nova-compute[73208]: INFO nova.compute.manager [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Took 19.57 seconds to build instance.
Aug 16 09:07:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-554d0c9c-914b-4cb9-a251-1812f9add2f0 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "9b4f9560-9aae-4591-9037-c76c1504f170" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.700s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-04eb74a5-e9b4-4cc8-8c2a-ac8f3ca84b0c req-65249a78-cdb2-43ae-a067-20d3d0faae9f service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received event network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04eb74a5-e9b4-4cc8-8c2a-ac8f3ca84b0c req-65249a78-cdb2-43ae-a067-20d3d0faae9f service nova] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04eb74a5-e9b4-4cc8-8c2a-ac8f3ca84b0c req-65249a78-cdb2-43ae-a067-20d3d0faae9f service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04eb74a5-e9b4-4cc8-8c2a-ac8f3ca84b0c req-65249a78-cdb2-43ae-a067-20d3d0faae9f service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-04eb74a5-e9b4-4cc8-8c2a-ac8f3ca84b0c req-65249a78-cdb2-43ae-a067-20d3d0faae9f service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] No waiting events found dispatching network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:44 user nova-compute[73208]: WARNING nova.compute.manager [req-04eb74a5-e9b4-4cc8-8c2a-ac8f3ca84b0c req-65249a78-cdb2-43ae-a067-20d3d0faae9f service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received unexpected event network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 for instance with vm_state active and task_state None.
Aug 16 09:07:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:07:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:07:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:07:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:07:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:07:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:07:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:07:51 user nova-compute[73208]: INFO nova.compute.claims [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Claim successful on node user
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:07:52 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:07:52 user nova-compute[73208]: INFO nova.virt.block_device [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Booting with volume 89b1f550-0229-45c1-a34e-38731543d97b at /dev/vda
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "0fb21b62-0a07-426e-983e-86a33994b653" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "0fb21b62-0a07-426e-983e-86a33994b653" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG os_brick.utils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[080582c1-34b5-454b-b64c-accae1c541f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.policy [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cedac6a6b631415fb63d0943cbfb1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37047b551d54c728c6da706a88a7efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec710168-d634-4e73-8de9-767e5b82a4f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:07:52 user nova-compute[73208]: INFO nova.compute.claims [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Claim successful on node user
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ec48d4-ba89-4647-ad3b-a59213f18fa6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a26cbb-5f98-48de-83d5-cfe00e284822]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:07:52 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:07:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1c4094-b47d-4173-9a02-19c9f76996de]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG os_brick.utils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:07:52 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating existing volume attachment record: 1ac3f82b-267d-4bbd-95c8-f6c6430d2557 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:07:53 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:07:53 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Creating image(s)
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "/opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "/opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.policy [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3089374bc7e6494ebafa5c1da64c77d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35b2da7c2dbb45718eb517187814aceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully created port: 5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.221s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk 1073741824" returned: 0 in 0.052s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:07:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Cannot resize image /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lazy-loading 'migration_context' on Instance uuid 0fb21b62-0a07-426e-983e-86a33994b653 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Ensure instance console log exists: /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully created port: 5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Successfully created port: d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:07:55 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully created port: 6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Successfully updated port: d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "refresh_cache-0fb21b62-0a07-426e-983e-86a33994b653" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquired lock "refresh_cache-0fb21b62-0a07-426e-983e-86a33994b653" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-c6b15db2-5f8e-4748-82f9-54479c1f5724 req-b31eb946-ae20-4f90-b352-d384bc71f246 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received event network-changed-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-c6b15db2-5f8e-4748-82f9-54479c1f5724 req-b31eb946-ae20-4f90-b352-d384bc71f246 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Refreshing instance network info cache due to event network-changed-d2af9033-c76a-4e5f-9927-07ae3b64e32e. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c6b15db2-5f8e-4748-82f9-54479c1f5724 req-b31eb946-ae20-4f90-b352-d384bc71f246 service nova] Acquiring lock "refresh_cache-0fb21b62-0a07-426e-983e-86a33994b653" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:07:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully created port: 40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Updating instance_info_cache with network_info: [{"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Releasing lock "refresh_cache-0fb21b62-0a07-426e-983e-86a33994b653" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Instance network_info: |[{"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c6b15db2-5f8e-4748-82f9-54479c1f5724 req-b31eb946-ae20-4f90-b352-d384bc71f246 service nova] Acquired lock "refresh_cache-0fb21b62-0a07-426e-983e-86a33994b653" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.neutron [req-c6b15db2-5f8e-4748-82f9-54479c1f5724 req-b31eb946-ae20-4f90-b352-d384bc71f246 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Refreshing network info cache for port d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Start _get_guest_xml network_info=[{"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:07:57 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:57 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1822706582',display_name='tempest-VolumesNegativeTest-instance-1822706582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1822706582',id=11,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35b2da7c2dbb45718eb517187814aceb',ramdisk_id='',reservation_id='r-yd3qzc3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1590915018',owner_user_name='tempest-VolumesNegativeTest-1590915018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:53Z,user_data=None,user_id='3089374bc7e6494ebafa5c1da64c77d5',uuid=0fb21b62-0a07-426e-983e-86a33994b653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Converting VIF {"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:56:38,bridge_name='br-int',has_traffic_filtering=True,id=d2af9033-c76a-4e5f-9927-07ae3b64e32e,network=Network(528760da-85a5-4c5f-9b78-3234efc0347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2af9033-c7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fb21b62-0a07-426e-983e-86a33994b653 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:07:57 user nova-compute[73208]:   <uuid>0fb21b62-0a07-426e-983e-86a33994b653</uuid>
Aug 16 09:07:57 user nova-compute[73208]:   <name>instance-0000000b</name>
Aug 16 09:07:57 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:07:57 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:07:57 user nova-compute[73208]:   <metadata>
Aug 16 09:07:57 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:07:57 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:07:57 user nova-compute[73208]:       <nova:name>tempest-VolumesNegativeTest-instance-1822706582</nova:name>
Aug 16 09:07:57 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:07:57</nova:creationTime>
Aug 16 09:07:57 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:07:57 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:07:57 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:07:57 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:07:57 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:07:57 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:07:57 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:07:57 user nova-compute[73208]:       <nova:owner>
Aug 16 09:07:57 user nova-compute[73208]:         <nova:user uuid="3089374bc7e6494ebafa5c1da64c77d5">tempest-VolumesNegativeTest-1590915018-project-member</nova:user>
Aug 16 09:07:57 user nova-compute[73208]:         <nova:project uuid="35b2da7c2dbb45718eb517187814aceb">tempest-VolumesNegativeTest-1590915018</nova:project>
Aug 16 09:07:57 user nova-compute[73208]:       </nova:owner>
Aug 16 09:07:57 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:07:57 user nova-compute[73208]:       <nova:ports>
Aug 16 09:07:57 user nova-compute[73208]:         <nova:port uuid="d2af9033-c76a-4e5f-9927-07ae3b64e32e">
Aug 16 09:07:57 user nova-compute[73208]:           <nova:ip type="fixed" address="192.168.233.85" ipVersion="4"/>
Aug 16 09:07:57 user nova-compute[73208]:         </nova:port>
Aug 16 09:07:57 user nova-compute[73208]:       </nova:ports>
Aug 16 09:07:57 user nova-compute[73208]:     </nova:instance>
Aug 16 09:07:57 user nova-compute[73208]:   </metadata>
Aug 16 09:07:57 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:07:57 user nova-compute[73208]:     <system>
Aug 16 09:07:57 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:07:57 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:07:57 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:07:57 user nova-compute[73208]:       <entry name="serial">0fb21b62-0a07-426e-983e-86a33994b653</entry>
Aug 16 09:07:57 user nova-compute[73208]:       <entry name="uuid">0fb21b62-0a07-426e-983e-86a33994b653</entry>
Aug 16 09:07:57 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:07:57 user nova-compute[73208]:     </system>
Aug 16 09:07:57 user nova-compute[73208]:   </sysinfo>
Aug 16 09:07:57 user nova-compute[73208]:   <os>
Aug 16 09:07:57 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:07:57 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:07:57 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:07:57 user nova-compute[73208]:   </os>
Aug 16 09:07:57 user nova-compute[73208]:   <features>
Aug 16 09:07:57 user nova-compute[73208]:     <acpi/>
Aug 16 09:07:57 user nova-compute[73208]:     <apic/>
Aug 16 09:07:57 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:07:57 user nova-compute[73208]:   </features>
Aug 16 09:07:57 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:07:57 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:07:57 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:07:57 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:07:57 user nova-compute[73208]:   </clock>
Aug 16 09:07:57 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:07:57 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:07:57 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:07:57 user nova-compute[73208]:   </cpu>
Aug 16 09:07:57 user nova-compute[73208]:   <devices>
Aug 16 09:07:57 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:07:57 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:07:57 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk"/>
Aug 16 09:07:57 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:07:57 user nova-compute[73208]:     </disk>
Aug 16 09:07:57 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:07:57 user nova-compute[73208]:       <mac address="fa:16:3e:dc:56:38"/>
Aug 16 09:07:57 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:07:57 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:07:57 user nova-compute[73208]:       <target dev="tapd2af9033-c7"/>
Aug 16 09:07:57 user nova-compute[73208]:     </interface>
Aug 16 09:07:57 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:07:57 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/console.log" append="off"/>
Aug 16 09:07:57 user nova-compute[73208]:     </serial>
Aug 16 09:07:57 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:07:57 user nova-compute[73208]:     <video>
Aug 16 09:07:57 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:07:57 user nova-compute[73208]:     </video>
Aug 16 09:07:57 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:07:57 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:07:57 user nova-compute[73208]:     </rng>
Aug 16 09:07:57 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:07:57 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:07:57 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:07:57 user nova-compute[73208]:     </memballoon>
Aug 16 09:07:57 user nova-compute[73208]:   </devices>
Aug 16 09:07:57 user nova-compute[73208]: </domain>
Aug 16 09:07:57 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1822706582',display_name='tempest-VolumesNegativeTest-instance-1822706582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1822706582',id=11,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35b2da7c2dbb45718eb517187814aceb',ramdisk_id='',reservation_id='r-yd3qzc3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1590915018',owner_user_name='tempest-VolumesNegativeTest-1590915018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:53Z,user_data=None,user_id='3089374bc7e6494ebafa5c1da64c77d5',uuid=0fb21b62-0a07-426e-983e-86a33994b653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Converting VIF {"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:56:38,bridge_name='br-int',has_traffic_filtering=True,id=d2af9033-c76a-4e5f-9927-07ae3b64e32e,network=Network(528760da-85a5-4c5f-9b78-3234efc0347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2af9033-c7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG os_vif [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:56:38,bridge_name='br-int',has_traffic_filtering=True,id=d2af9033-c76a-4e5f-9927-07ae3b64e32e,network=Network(528760da-85a5-4c5f-9b78-3234efc0347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2af9033-c7') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2af9033-c7, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2af9033-c7, col_values=(('external_ids', {'iface-id': 'd2af9033-c76a-4e5f-9927-07ae3b64e32e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:56:38', 'vm-uuid': '0fb21b62-0a07-426e-983e-86a33994b653'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:57 user nova-compute[73208]: INFO os_vif [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:56:38,bridge_name='br-int',has_traffic_filtering=True,id=d2af9033-c76a-4e5f-9927-07ae3b64e32e,network=Network(528760da-85a5-4c5f-9b78-3234efc0347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2af9033-c7')
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] No VIF found with MAC fa:16:3e:dc:56:38, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.neutron [req-c6b15db2-5f8e-4748-82f9-54479c1f5724 req-b31eb946-ae20-4f90-b352-d384bc71f246 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Updated VIF entry in instance network info cache for port d2af9033-c76a-4e5f-9927-07ae3b64e32e. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.neutron [req-c6b15db2-5f8e-4748-82f9-54479c1f5724 req-b31eb946-ae20-4f90-b352-d384bc71f246 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Updating instance_info_cache with network_info: [{"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c6b15db2-5f8e-4748-82f9-54479c1f5724 req-b31eb946-ae20-4f90-b352-d384bc71f246 service nova] Releasing lock "refresh_cache-0fb21b62-0a07-426e-983e-86a33994b653" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:07:57 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully created port: 43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully updated port: 5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-b52fe196-c71e-425f-84a6-e64590d03404 req-55339cb5-7363-481a-9660-719abac921ea service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-changed-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-b52fe196-c71e-425f-84a6-e64590d03404 req-55339cb5-7363-481a-9660-719abac921ea service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing instance network info cache due to event network-changed-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b52fe196-c71e-425f-84a6-e64590d03404 req-55339cb5-7363-481a-9660-719abac921ea service nova] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b52fe196-c71e-425f-84a6-e64590d03404 req-55339cb5-7363-481a-9660-719abac921ea service nova] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:07:58 user nova-compute[73208]: DEBUG nova.network.neutron [req-b52fe196-c71e-425f-84a6-e64590d03404 req-55339cb5-7363-481a-9660-719abac921ea service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing network info cache for port 5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG nova.network.neutron [req-b52fe196-c71e-425f-84a6-e64590d03404 req-55339cb5-7363-481a-9660-719abac921ea service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-5d9f34b2-bfc8-45b5-87e0-46c5e90bdbf8 req-e72b12db-d671-4aa9-a181-39feee7f99d7 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received event network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5d9f34b2-bfc8-45b5-87e0-46c5e90bdbf8 req-e72b12db-d671-4aa9-a181-39feee7f99d7 service nova] Acquiring lock "0fb21b62-0a07-426e-983e-86a33994b653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5d9f34b2-bfc8-45b5-87e0-46c5e90bdbf8 req-e72b12db-d671-4aa9-a181-39feee7f99d7 service nova] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5d9f34b2-bfc8-45b5-87e0-46c5e90bdbf8 req-e72b12db-d671-4aa9-a181-39feee7f99d7 service nova] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-5d9f34b2-bfc8-45b5-87e0-46c5e90bdbf8 req-e72b12db-d671-4aa9-a181-39feee7f99d7 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] No waiting events found dispatching network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:07:59 user nova-compute[73208]: WARNING nova.compute.manager [req-5d9f34b2-bfc8-45b5-87e0-46c5e90bdbf8 req-e72b12db-d671-4aa9-a181-39feee7f99d7 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received unexpected event network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e for instance with vm_state building and task_state spawning.
Aug 16 09:07:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG nova.network.neutron [req-b52fe196-c71e-425f-84a6-e64590d03404 req-55339cb5-7363-481a-9660-719abac921ea service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:07:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b52fe196-c71e-425f-84a6-e64590d03404 req-55339cb5-7363-481a-9660-719abac921ea service nova] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:00 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully updated port: 8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:08:00 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully updated port: ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176881.090836, 0fb21b62-0a07-426e-983e-86a33994b653 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:08:01 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] VM Resumed (Lifecycle Event)
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:08:01 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Instance spawned successfully.
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:08:01 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176881.0928774, 0fb21b62-0a07-426e-983e-86a33994b653 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:08:01 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] VM Started (Lifecycle Event)
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-ed909cc9-4a36-4fde-9de6-b9814dd61bdd req-b5210502-fcad-4cf3-980a-e28c21998873 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received event network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ed909cc9-4a36-4fde-9de6-b9814dd61bdd req-b5210502-fcad-4cf3-980a-e28c21998873 service nova] Acquiring lock "0fb21b62-0a07-426e-983e-86a33994b653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ed909cc9-4a36-4fde-9de6-b9814dd61bdd req-b5210502-fcad-4cf3-980a-e28c21998873 service nova] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ed909cc9-4a36-4fde-9de6-b9814dd61bdd req-b5210502-fcad-4cf3-980a-e28c21998873 service nova] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-ed909cc9-4a36-4fde-9de6-b9814dd61bdd req-b5210502-fcad-4cf3-980a-e28c21998873 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] No waiting events found dispatching network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:01 user nova-compute[73208]: WARNING nova.compute.manager [req-ed909cc9-4a36-4fde-9de6-b9814dd61bdd req-b5210502-fcad-4cf3-980a-e28c21998873 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received unexpected event network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e for instance with vm_state building and task_state spawning.
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-changed-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing instance network info cache due to event network-changed-8b77492c-96a5-4be1-99d4-eb060e5ef241. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing network info cache for port 8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:01 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:08:01 user nova-compute[73208]: INFO nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Took 7.92 seconds to spawn the instance on the hypervisor.
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:08:01 user nova-compute[73208]: INFO nova.compute.manager [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Took 8.78 seconds to build instance.
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8f0f148c-cd43-43ff-99c4-a1b64d19edc2 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "0fb21b62-0a07-426e-983e-86a33994b653" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.885s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-changed-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing instance network info cache due to event network-changed-ff69ee3b-5ba0-4da4-811e-eb1af566603d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing network info cache for port ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:08:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:02 user nova-compute[73208]: DEBUG nova.network.neutron [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-82c8a01c-0c0b-4bbb-a88f-a0900f676583 req-887ca94a-c957-4251-ab79-d61c37577667 service nova] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully updated port: 5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-235473fa-4fd5-46b4-8a21-dc1f7e2853f3 req-18e4d0e4-923c-470f-8b58-415898a66ef8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-changed-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-235473fa-4fd5-46b4-8a21-dc1f7e2853f3 req-18e4d0e4-923c-470f-8b58-415898a66ef8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing instance network info cache due to event network-changed-5035b4ea-1ac0-45c7-a299-5277719d9fff. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-235473fa-4fd5-46b4-8a21-dc1f7e2853f3 req-18e4d0e4-923c-470f-8b58-415898a66ef8 service nova] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-235473fa-4fd5-46b4-8a21-dc1f7e2853f3 req-18e4d0e4-923c-470f-8b58-415898a66ef8 service nova] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG nova.network.neutron [req-235473fa-4fd5-46b4-8a21-dc1f7e2853f3 req-18e4d0e4-923c-470f-8b58-415898a66ef8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing network info cache for port 5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully updated port: 6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG nova.network.neutron [req-235473fa-4fd5-46b4-8a21-dc1f7e2853f3 req-18e4d0e4-923c-470f-8b58-415898a66ef8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG nova.network.neutron [req-235473fa-4fd5-46b4-8a21-dc1f7e2853f3 req-18e4d0e4-923c-470f-8b58-415898a66ef8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-235473fa-4fd5-46b4-8a21-dc1f7e2853f3 req-18e4d0e4-923c-470f-8b58-415898a66ef8 service nova] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:03 user nova-compute[73208]: INFO nova.virt.block_device [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Booting with volume 3fc2da6d-f3dc-4741-a70e-a90dd608aea4 at /dev/vdb
Aug 16 09:08:04 user nova-compute[73208]: DEBUG os_brick.utils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[27146862-761d-4dd2-8c14-6f9687c05c6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323b533-1b3b-4109-a22f-e27bec66b92c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e4fbab-c1f5-494f-83e2-f3d1543731b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[937e061e-ae91-4a0f-87f0-1cfd1a9bcb0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:04 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:08:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d33ef7-b8b9-4041-91f1-9f6559150bb3]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG os_brick.utils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating existing volume attachment record: 7f072304-2c02-42c8-a621-d9599c2e9a88 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully updated port: 40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:08:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Successfully updated port: 43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:08:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:08:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:08:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-changed-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing instance network info cache due to event network-changed-6b64fd22-8774-490c-99cb-2f427c019ed5. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:07 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [{"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance network_info: |[{"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:08:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing network info cache for port 6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updated VIF entry in instance network info cache for port 6b64fd22-8774-490c-99cb-2f427c019ed5. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [{"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-changed-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing instance network info cache due to event network-changed-40fb0fe9-3e51-4a07-89a4-67267cc274b3. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing network info cache for port 40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updated VIF entry in instance network info cache for port 40fb0fe9-3e51-4a07-89a4-67267cc274b3. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [{"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-changed-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing instance network info cache due to event network-changed-43e03d2b-f637-424a-837b-7fe1b7f5c87f. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing network info cache for port 43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:09 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updated VIF entry in instance network info cache for port 43e03d2b-f637-424a-837b-7fe1b7f5c87f. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:09 user nova-compute[73208]: DEBUG nova.network.neutron [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [{"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d20b9870-81c3-4f73-ac14-75dad4a90781 req-58677d4f-dbbd-4610-a869-ee4da52b9c39 service nova] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:14 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:14 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:08:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: INFO nova.virt.block_device [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Booting with volume fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 at /dev/vdc
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG os_brick.utils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0675cbe2-5ef4-460b-9686-5c701c58ecba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2127119e-e145-45e5-a356-57ce1a769642]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f358ba-1161-490a-8ca5-b9b47252cdcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[063ecf1c-7758-49a5-b3f2-ef5aaa5514a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:16 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:08:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db7b0e0-4a16-460f-8d1a-b21cfad1f9ad]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG os_brick.utils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating existing volume attachment record: 42bae238-c4cd-4c84-a3e0-7ae8317ee9ff {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:19 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:08:19 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=6797MB free_disk=25.782272338867188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ee15c9d4-1895-4afa-bd25-d21098b0ca34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 84819dea-4fd7-44cd-83a1-10e62263edca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 341d90a7-086a-42ce-9c23-d3422883d13e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9b4f9560-9aae-4591-9037-c76c1504f170 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9333a6d0-50a9-456a-8948-6f0f20ed8b45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0fb21b62-0a07-426e-983e-86a33994b653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:08:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:20 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:20 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:08:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:08:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:08:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:08:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:08:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG nova.compute.manager [req-45124a11-7829-415a-b6dc-5d0d4867aeaf req-731461e7-119b-421c-b3fd-d23394c3be31 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-changed-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG nova.compute.manager [req-45124a11-7829-415a-b6dc-5d0d4867aeaf req-731461e7-119b-421c-b3fd-d23394c3be31 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Refreshing instance network info cache due to event network-changed-0bbaa277-2952-499a-9b56-e0dc09d81095. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-45124a11-7829-415a-b6dc-5d0d4867aeaf req-731461e7-119b-421c-b3fd-d23394c3be31 service nova] Acquiring lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-45124a11-7829-415a-b6dc-5d0d4867aeaf req-731461e7-119b-421c-b3fd-d23394c3be31 service nova] Acquired lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG nova.network.neutron [req-45124a11-7829-415a-b6dc-5d0d4867aeaf req-731461e7-119b-421c-b3fd-d23394c3be31 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Refreshing network info cache for port 0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG nova.network.neutron [req-45124a11-7829-415a-b6dc-5d0d4867aeaf req-731461e7-119b-421c-b3fd-d23394c3be31 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updated VIF entry in instance network info cache for port 0bbaa277-2952-499a-9b56-e0dc09d81095. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG nova.network.neutron [req-45124a11-7829-415a-b6dc-5d0d4867aeaf req-731461e7-119b-421c-b3fd-d23394c3be31 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-45124a11-7829-415a-b6dc-5d0d4867aeaf req-731461e7-119b-421c-b3fd-d23394c3be31 service nova] Releasing lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-ac2d221f-6fde-49d4-b289-51f4a5120f59 req-9b8eb3ab-dfdf-4860-b907-8c871b74df40 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-changed-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-ac2d221f-6fde-49d4-b289-51f4a5120f59 req-9b8eb3ab-dfdf-4860-b907-8c871b74df40 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Refreshing instance network info cache due to event network-changed-7a69891b-a5ef-4e60-9977-86c0cad59f1c. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ac2d221f-6fde-49d4-b289-51f4a5120f59 req-9b8eb3ab-dfdf-4860-b907-8c871b74df40 service nova] Acquiring lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ac2d221f-6fde-49d4-b289-51f4a5120f59 req-9b8eb3ab-dfdf-4860-b907-8c871b74df40 service nova] Acquired lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG nova.network.neutron [req-ac2d221f-6fde-49d4-b289-51f4a5120f59 req-9b8eb3ab-dfdf-4860-b907-8c871b74df40 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Refreshing network info cache for port 7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lazy-loading 'flavor' on Instance uuid ee15c9d4-1895-4afa-bd25-d21098b0ca34 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-34c44301-0198-4ddf-85f8-e0b5ec3c52f4 req-65dd1309-b68b-4f01-8013-cfba0b05f3bc service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-changed-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-34c44301-0198-4ddf-85f8-e0b5ec3c52f4 req-65dd1309-b68b-4f01-8013-cfba0b05f3bc service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Refreshing instance network info cache due to event network-changed-9b934682-5a56-428d-8362-8cb499a85a94. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-34c44301-0198-4ddf-85f8-e0b5ec3c52f4 req-65dd1309-b68b-4f01-8013-cfba0b05f3bc service nova] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-34c44301-0198-4ddf-85f8-e0b5ec3c52f4 req-65dd1309-b68b-4f01-8013-cfba0b05f3bc service nova] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG nova.network.neutron [req-34c44301-0198-4ddf-85f8-e0b5ec3c52f4 req-65dd1309-b68b-4f01-8013-cfba0b05f3bc service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Refreshing network info cache for port 9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:26 user nova-compute[73208]: INFO nova.compute.manager [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Attaching volume 3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 to /dev/vdb
Aug 16 09:08:26 user nova-compute[73208]: DEBUG os_brick.utils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d6d9bd-5b88-4993-afa3-3b95156b5e4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e41da8-e6e0-4f5b-ba22-58b49f003134]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[01248d42-fc6c-4bc8-923c-0a1ab365940b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd25c53-89b6-478a-91c8-1ba64b9216fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG nova.network.neutron [req-ac2d221f-6fde-49d4-b289-51f4a5120f59 req-9b8eb3ab-dfdf-4860-b907-8c871b74df40 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updated VIF entry in instance network info cache for port 7a69891b-a5ef-4e60-9977-86c0cad59f1c. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG nova.network.neutron [req-ac2d221f-6fde-49d4-b289-51f4a5120f59 req-9b8eb3ab-dfdf-4860-b907-8c871b74df40 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ac2d221f-6fde-49d4-b289-51f4a5120f59 req-9b8eb3ab-dfdf-4860-b907-8c871b74df40 service nova] Releasing lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:27 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c3931d-54e6-4418-858d-808f706310fd]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG os_brick.utils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Updating existing volume attachment record: 6ca89476-6c61-4c65-ad8d-ccb3ab2160b0 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG nova.network.neutron [req-34c44301-0198-4ddf-85f8-e0b5ec3c52f4 req-65dd1309-b68b-4f01-8013-cfba0b05f3bc service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updated VIF entry in instance network info cache for port 9b934682-5a56-428d-8362-8cb499a85a94. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG nova.network.neutron [req-34c44301-0198-4ddf-85f8-e0b5ec3c52f4 req-65dd1309-b68b-4f01-8013-cfba0b05f3bc service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-34c44301-0198-4ddf-85f8-e0b5ec3c52f4 req-65dd1309-b68b-4f01-8013-cfba0b05f3bc service nova] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:08:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Creating image(s)
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Ensure instance console log exists: /opt/stack/data/nova/instances/9333a6d0-50a9-456a-8948-6f0f20ed8b45/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Start _get_guest_xml network_info=[{"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '1ac3f82b-267d-4bbd-95c8-f6c6430d2557', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVxUJmro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9333a6d0-50a9-456a-8948-6f0f20ed8b45', 'attached_at': '', 'detached_at': '', 'volume_id': '89b1f550-0229-45c1-a34e-38731543d97b', 'serial': '89b1f550-0229-45c1-a34e-38731543d97b'}, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '7f072304-2c02-42c8-a621-d9599c2e9a88', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdLUpoZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9333a6d0-50a9-456a-8948-6f0f20ed8b45', 'attached_at': '', 'detached_at': '', 'volume_id': '3fc2da6d-f3dc-4741-a70e-a90dd608aea4', 'serial': '3fc2da6d-f3dc-4741-a70e-a90dd608aea4'}, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '42bae238-c4cd-4c84-a3e0-7ae8317ee9ff', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKwDrQlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9333a6d0-50a9-456a-8948-6f0f20ed8b45', 'attached_at': '', 'detached_at': '', 'volume_id': 'fabe78cc-5dbc-4aa2-bbb1-177d15a158f0', 'serial': 'fabe78cc-5dbc-4aa2-bbb1-177d15a158f0'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:08:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:08:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVxUJmro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:28 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:28 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:28 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd73f692-3303-46f2-a0bf-fedfb17c8d6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:08:28 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3cffa2-3526-4e01-a9a4-eb9c0616d9fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b] added
Aug 16 09:08:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[18892bf7-9701-450b-a2c7-a8498fe395f7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1027890c-57ec-4621-a306-3e6dbe6b9a39]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVxUJmro {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVxUJmro" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590aed4-d056-45fb-8599-eee899589e4e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gVxUJmro'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccd3a2e-ebf7-44f0-9fb9-6f278963e44e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b257e9c-bfb4-4cfc-9496-b6923a8928c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9311ef23-e7d9-4408-a527-75f3346cbe15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b, portal: 172.16.0.220,3260]
Aug 16 09:08:28 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b, portal: 172.16.0.220,3260] successful.
Aug 16 09:08:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[560b62a6-96e6-4911-bf2f-18b10c9ba852]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[93af2b57-17a0-45af-bdaf-f7be1410139e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:29 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:29 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:29 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:29 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[de992553-d205-44bd-a62d-fe60b0dd396f]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVxUJmro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG nova.compute.manager [req-1166ca8a-aa8c-4737-835d-d4d44031b3e9 req-19f9b9be-0152-42c3-a54e-0f6ad4ee343d service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-changed-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG nova.compute.manager [req-1166ca8a-aa8c-4737-835d-d4d44031b3e9 req-19f9b9be-0152-42c3-a54e-0f6ad4ee343d service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Refreshing instance network info cache due to event network-changed-898d4cd1-4f35-4e2c-b563-202493263a7b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1166ca8a-aa8c-4737-835d-d4d44031b3e9 req-19f9b9be-0152-42c3-a54e-0f6ad4ee343d service nova] Acquiring lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1166ca8a-aa8c-4737-835d-d4d44031b3e9 req-19f9b9be-0152-42c3-a54e-0f6ad4ee343d service nova] Acquired lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG nova.network.neutron [req-1166ca8a-aa8c-4737-835d-d4d44031b3e9 req-19f9b9be-0152-42c3-a54e-0f6ad4ee343d service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Refreshing network info cache for port 898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG nova.network.neutron [req-1166ca8a-aa8c-4737-835d-d4d44031b3e9 req-19f9b9be-0152-42c3-a54e-0f6ad4ee343d service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updated VIF entry in instance network info cache for port 898d4cd1-4f35-4e2c-b563-202493263a7b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG nova.network.neutron [req-1166ca8a-aa8c-4737-835d-d4d44031b3e9 req-19f9b9be-0152-42c3-a54e-0f6ad4ee343d service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating instance_info_cache with network_info: [{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1166ca8a-aa8c-4737-835d-d4d44031b3e9 req-19f9b9be-0152-42c3-a54e-0f6ad4ee343d service nova] Releasing lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23166333036323839', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166333036323839', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:30 user nova-compute[73208]: INFO nova.compute.manager [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Shelving
Aug 16 09:08:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdLUpoZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:30 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:30 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:30 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[44debd1b-7e79-4be0-bba7-6cc57171f985]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:08:30 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca07a2e6-5a6f-4e13-871f-cae040c78ff5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4] added
Aug 16 09:08:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a315554-efa3-4dc0-b580-6345b48a12bb]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[311547ce-746e-4b7e-98ff-5476a3579b3a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdLUpoZr {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdLUpoZr" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5c8b7-2018-4fb9-80b6-5404c940d2f4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TdLUpoZr'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ecb22e-c773-4cea-a12c-f823175ee325]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3343b5f-3782-4edf-981e-4ccd0d229579]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:30 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:30 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-dbd7aa2c-5311-4f04-b933-0462fd7a7e23 req-559a9da1-4aac-44d3-ab08-b66e0f935de0 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-unplugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dbd7aa2c-5311-4f04-b933-0462fd7a7e23 req-559a9da1-4aac-44d3-ab08-b66e0f935de0 service nova] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dbd7aa2c-5311-4f04-b933-0462fd7a7e23 req-559a9da1-4aac-44d3-ab08-b66e0f935de0 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dbd7aa2c-5311-4f04-b933-0462fd7a7e23 req-559a9da1-4aac-44d3-ab08-b66e0f935de0 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-dbd7aa2c-5311-4f04-b933-0462fd7a7e23 req-559a9da1-4aac-44d3-ab08-b66e0f935de0 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] No waiting events found dispatching network-vif-unplugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:30 user nova-compute[73208]: WARNING nova.compute.manager [req-dbd7aa2c-5311-4f04-b933-0462fd7a7e23 req-559a9da1-4aac-44d3-ab08-b66e0f935de0 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received unexpected event network-vif-unplugged-0bbaa277-2952-499a-9b56-e0dc09d81095 for instance with vm_state active and task_state shelving.
Aug 16 09:08:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance destroyed successfully.
Aug 16 09:08:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Beginning cold snapshot process
Aug 16 09:08:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk /opt/stack/data/nova/instances/snapshots/tmpb3_vscix/d69eb7586ac042fc929552b11a429207 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --login" returned: 0 in 1.065s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[92baf231-e07b-4586-baea-247720bc871c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4, portal: 172.16.0.220,3260]
Aug 16 09:08:31 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4, portal: 172.16.0.220,3260] successful.
Aug 16 09:08:31 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[53042595-0ea2-426f-bd51-bd51dec7252e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[321b9056-fef6-4510-81a0-981dd5bbfe91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:31 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:31 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:31 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:31 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:31 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:31 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.350s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf8c8e8-dbf7-4b23-bc7b-86fe5ba8f0bb]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:08:31 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdLUpoZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk /opt/stack/data/nova/instances/snapshots/tmpb3_vscix/d69eb7586ac042fc929552b11a429207" returned: 0 in 0.768s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Snapshot extracted, beginning image upload
Aug 16 09:08:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.399s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== connect_volume: return (2401ms) {'type': 'block', 'scsi_wwn': '23464323963353266', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464323963353266', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKwDrQlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:32 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:32 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:32 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e143c32d-c92e-4ef6-ad6d-529bfcf6e6d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:08:32 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd3a11-3c96-4f62-b7a1-93439ffb5be3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0] added
Aug 16 09:08:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c64dc5b-1b17-4ca4-a08d-a5deb45edb87]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25ad149-bc3a-409d-9c83-ba2df499aef8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKwDrQlO {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKwDrQlO" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9836d8-fb24-4f9e-9683-6df8c52ce7c4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FKwDrQlO'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cde064-f9f0-4673-8814-6926a4458c7a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[95df0e98-3b39-4af9-9f22-2ecae54c1f1e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc43c0d-4813-48a0-84ac-9351809b544f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0, portal: 172.16.0.220,3260]
Aug 16 09:08:32 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0, portal: 172.16.0.220,3260] successful.
Aug 16 09:08:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02854d-78a3-4188-ad90-4d9e1169f06c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-12df2e73-148d-4f4b-8e34-53281b457b39 req-6774875f-3f2f-4738-98ac-aded6c4025f4 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-12df2e73-148d-4f4b-8e34-53281b457b39 req-6774875f-3f2f-4738-98ac-aded6c4025f4 service nova] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-12df2e73-148d-4f4b-8e34-53281b457b39 req-6774875f-3f2f-4738-98ac-aded6c4025f4 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-12df2e73-148d-4f4b-8e34-53281b457b39 req-6774875f-3f2f-4738-98ac-aded6c4025f4 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-12df2e73-148d-4f4b-8e34-53281b457b39 req-6774875f-3f2f-4738-98ac-aded6c4025f4 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] No waiting events found dispatching network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:32 user nova-compute[73208]: WARNING nova.compute.manager [req-12df2e73-148d-4f4b-8e34-53281b457b39 req-6774875f-3f2f-4738-98ac-aded6c4025f4 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received unexpected event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac63c20-7b53-44cf-95fd-881ff671cf10]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:08:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:32 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:08:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ac29ee-67c0-4912-af63-ab2454911a6c]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:08:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKwDrQlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23635393536303261', 'path': '/dev/sde'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635393536303261', 'path': '/dev/sde'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:44:e6,bridge_name='br-int',has_traffic_filtering=True,id=5b9c094e-ebb8-4e0a-81b2-b375ad98cc05,network=Network(afaa9554-c213-49c8-8f78-6003892349b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b9c094e-eb') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:5a:c2,bridge_name='br-int',has_traffic_filtering=True,id=8b77492c-96a5-4be1-99d4-eb060e5ef241,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b77492c-96') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:54,bridge_name='br-int',has_traffic_filtering=True,id=ff69ee3b-5ba0-4da4-811e-eb1af566603d,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff69ee3b-5b') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=5035b4ea-1ac0-45c7-a299-5277719d9fff,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5035b4ea-1a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:56:87,bridge_name='br-int',has_traffic_filtering=True,id=6b64fd22-8774-490c-99cb-2f427c019ed5,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b64fd22-87') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8d:82,bridge_name='br-int',has_traffic_filtering=True,id=40fb0fe9-3e51-4a07-89a4-67267cc274b3,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40fb0fe9-3e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:73:5f,bridge_name='br-int',has_traffic_filtering=True,id=43e03d2b-f637-424a-837b-7fe1b7f5c87f,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e03d2b-f6') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lazy-loading 'pci_devices' on Instance uuid 9333a6d0-50a9-456a-8948-6f0f20ed8b45 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:08:33 user nova-compute[73208]:   <uuid>9333a6d0-50a9-456a-8948-6f0f20ed8b45</uuid>
Aug 16 09:08:33 user nova-compute[73208]:   <name>instance-0000000a</name>
Aug 16 09:08:33 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:08:33 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:08:33 user nova-compute[73208]:   <metadata>
Aug 16 09:08:33 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:08:33 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:08:33 user nova-compute[73208]:       <nova:name>tempest-device-tagging-server-1307880921</nova:name>
Aug 16 09:08:33 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:08:28</nova:creationTime>
Aug 16 09:08:33 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:08:33 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:08:33 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:08:33 user nova-compute[73208]:       <nova:owner>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:user uuid="cedac6a6b631415fb63d0943cbfb1275">tempest-TaggedBootDevicesTest-1301421956-project-member</nova:user>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:project uuid="d37047b551d54c728c6da706a88a7efb">tempest-TaggedBootDevicesTest-1301421956</nova:project>
Aug 16 09:08:33 user nova-compute[73208]:       </nova:owner>
Aug 16 09:08:33 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:08:33 user nova-compute[73208]:       <nova:ports>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:port uuid="5b9c094e-ebb8-4e0a-81b2-b375ad98cc05">
Aug 16 09:08:33 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 09:08:33 user nova-compute[73208]:         </nova:port>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:port uuid="8b77492c-96a5-4be1-99d4-eb060e5ef241">
Aug 16 09:08:33 user nova-compute[73208]:           <nova:ip type="fixed" address="10.1.1.50" ipVersion="4"/>
Aug 16 09:08:33 user nova-compute[73208]:         </nova:port>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:port uuid="ff69ee3b-5ba0-4da4-811e-eb1af566603d">
Aug 16 09:08:33 user nova-compute[73208]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Aug 16 09:08:33 user nova-compute[73208]:         </nova:port>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:port uuid="5035b4ea-1ac0-45c7-a299-5277719d9fff">
Aug 16 09:08:33 user nova-compute[73208]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Aug 16 09:08:33 user nova-compute[73208]:         </nova:port>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:port uuid="6b64fd22-8774-490c-99cb-2f427c019ed5">
Aug 16 09:08:33 user nova-compute[73208]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
Aug 16 09:08:33 user nova-compute[73208]:         </nova:port>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:port uuid="40fb0fe9-3e51-4a07-89a4-67267cc274b3">
Aug 16 09:08:33 user nova-compute[73208]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 09:08:33 user nova-compute[73208]:         </nova:port>
Aug 16 09:08:33 user nova-compute[73208]:         <nova:port uuid="43e03d2b-f637-424a-837b-7fe1b7f5c87f">
Aug 16 09:08:33 user nova-compute[73208]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 09:08:33 user nova-compute[73208]:         </nova:port>
Aug 16 09:08:33 user nova-compute[73208]:       </nova:ports>
Aug 16 09:08:33 user nova-compute[73208]:     </nova:instance>
Aug 16 09:08:33 user nova-compute[73208]:   </metadata>
Aug 16 09:08:33 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:08:33 user nova-compute[73208]:     <system>
Aug 16 09:08:33 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:08:33 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:08:33 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:08:33 user nova-compute[73208]:       <entry name="serial">9333a6d0-50a9-456a-8948-6f0f20ed8b45</entry>
Aug 16 09:08:33 user nova-compute[73208]:       <entry name="uuid">9333a6d0-50a9-456a-8948-6f0f20ed8b45</entry>
Aug 16 09:08:33 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:08:33 user nova-compute[73208]:     </system>
Aug 16 09:08:33 user nova-compute[73208]:   </sysinfo>
Aug 16 09:08:33 user nova-compute[73208]:   <os>
Aug 16 09:08:33 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:08:33 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:08:33 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:08:33 user nova-compute[73208]:   </os>
Aug 16 09:08:33 user nova-compute[73208]:   <features>
Aug 16 09:08:33 user nova-compute[73208]:     <acpi/>
Aug 16 09:08:33 user nova-compute[73208]:     <apic/>
Aug 16 09:08:33 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:08:33 user nova-compute[73208]:   </features>
Aug 16 09:08:33 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:08:33 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:08:33 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:08:33 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:08:33 user nova-compute[73208]:   </clock>
Aug 16 09:08:33 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:08:33 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:08:33 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:08:33 user nova-compute[73208]:   </cpu>
Aug 16 09:08:33 user nova-compute[73208]:   <devices>
Aug 16 09:08:33 user nova-compute[73208]:     <disk type="file" device="cdrom">
Aug 16 09:08:33 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 09:08:33 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/9333a6d0-50a9-456a-8948-6f0f20ed8b45/disk.config"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="hda" bus="ide"/>
Aug 16 09:08:33 user nova-compute[73208]:     </disk>
Aug 16 09:08:33 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:08:33 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:08:33 user nova-compute[73208]:       <source dev="/dev/sdc"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <serial>89b1f550-0229-45c1-a34e-38731543d97b</serial>
Aug 16 09:08:33 user nova-compute[73208]:     </disk>
Aug 16 09:08:33 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:08:33 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:08:33 user nova-compute[73208]:       <source dev="/dev/sdd"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <serial>3fc2da6d-f3dc-4741-a70e-a90dd608aea4</serial>
Aug 16 09:08:33 user nova-compute[73208]:     </disk>
Aug 16 09:08:33 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:08:33 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:08:33 user nova-compute[73208]:       <source dev="/dev/sde"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="vdc" bus="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <serial>fabe78cc-5dbc-4aa2-bbb1-177d15a158f0</serial>
Aug 16 09:08:33 user nova-compute[73208]:     </disk>
Aug 16 09:08:33 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:08:33 user nova-compute[73208]:       <mac address="fa:16:3e:08:44:e6"/>
Aug 16 09:08:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="tap5b9c094e-eb"/>
Aug 16 09:08:33 user nova-compute[73208]:     </interface>
Aug 16 09:08:33 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:08:33 user nova-compute[73208]:       <mac address="fa:16:3e:07:5a:c2"/>
Aug 16 09:08:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="tap8b77492c-96"/>
Aug 16 09:08:33 user nova-compute[73208]:     </interface>
Aug 16 09:08:33 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:08:33 user nova-compute[73208]:       <mac address="fa:16:3e:86:5c:54"/>
Aug 16 09:08:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="tapff69ee3b-5b"/>
Aug 16 09:08:33 user nova-compute[73208]:     </interface>
Aug 16 09:08:33 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:08:33 user nova-compute[73208]:       <mac address="fa:16:3e:33:f8:14"/>
Aug 16 09:08:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="tap5035b4ea-1a"/>
Aug 16 09:08:33 user nova-compute[73208]:     </interface>
Aug 16 09:08:33 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:08:33 user nova-compute[73208]:       <mac address="fa:16:3e:19:56:87"/>
Aug 16 09:08:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="tap6b64fd22-87"/>
Aug 16 09:08:33 user nova-compute[73208]:     </interface>
Aug 16 09:08:33 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:08:33 user nova-compute[73208]:       <mac address="fa:16:3e:cc:8d:82"/>
Aug 16 09:08:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="tap40fb0fe9-3e"/>
Aug 16 09:08:33 user nova-compute[73208]:     </interface>
Aug 16 09:08:33 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:08:33 user nova-compute[73208]:       <mac address="fa:16:3e:3c:73:5f"/>
Aug 16 09:08:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:08:33 user nova-compute[73208]:       <target dev="tap43e03d2b-f6"/>
Aug 16 09:08:33 user nova-compute[73208]:     </interface>
Aug 16 09:08:33 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:08:33 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/9333a6d0-50a9-456a-8948-6f0f20ed8b45/console.log" append="off"/>
Aug 16 09:08:33 user nova-compute[73208]:     </serial>
Aug 16 09:08:33 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:08:33 user nova-compute[73208]:     <video>
Aug 16 09:08:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:08:33 user nova-compute[73208]:     </video>
Aug 16 09:08:33 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:08:33 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:08:33 user nova-compute[73208]:     </rng>
Aug 16 09:08:33 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:08:33 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:08:33 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:08:33 user nova-compute[73208]:     </memballoon>
Aug 16 09:08:33 user nova-compute[73208]:   </devices>
Aug 16 09:08:33 user nova-compute[73208]: </domain>
Aug 16 09:08:33 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:44:e6,bridge_name='br-int',has_traffic_filtering=True,id=5b9c094e-ebb8-4e0a-81b2-b375ad98cc05,network=Network(afaa9554-c213-49c8-8f78-6003892349b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b9c094e-eb') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:44:e6,bridge_name='br-int',has_traffic_filtering=True,id=5b9c094e-ebb8-4e0a-81b2-b375ad98cc05,network=Network(afaa9554-c213-49c8-8f78-6003892349b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b9c094e-eb') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b9c094e-eb, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b9c094e-eb, col_values=(('external_ids', {'iface-id': '5b9c094e-ebb8-4e0a-81b2-b375ad98cc05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:44:e6', 'vm-uuid': '9333a6d0-50a9-456a-8948-6f0f20ed8b45'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: INFO os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:44:e6,bridge_name='br-int',has_traffic_filtering=True,id=5b9c094e-ebb8-4e0a-81b2-b375ad98cc05,network=Network(afaa9554-c213-49c8-8f78-6003892349b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b9c094e-eb')
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:5a:c2,bridge_name='br-int',has_traffic_filtering=True,id=8b77492c-96a5-4be1-99d4-eb060e5ef241,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b77492c-96') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:5a:c2,bridge_name='br-int',has_traffic_filtering=True,id=8b77492c-96a5-4be1-99d4-eb060e5ef241,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b77492c-96') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b77492c-96, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b77492c-96, col_values=(('external_ids', {'iface-id': '8b77492c-96a5-4be1-99d4-eb060e5ef241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:5a:c2', 'vm-uuid': '9333a6d0-50a9-456a-8948-6f0f20ed8b45'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: INFO os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:5a:c2,bridge_name='br-int',has_traffic_filtering=True,id=8b77492c-96a5-4be1-99d4-eb060e5ef241,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b77492c-96')
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:54,bridge_name='br-int',has_traffic_filtering=True,id=ff69ee3b-5ba0-4da4-811e-eb1af566603d,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff69ee3b-5b') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:54,bridge_name='br-int',has_traffic_filtering=True,id=ff69ee3b-5ba0-4da4-811e-eb1af566603d,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff69ee3b-5b') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff69ee3b-5b, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff69ee3b-5b, col_values=(('external_ids', {'iface-id': 'ff69ee3b-5ba0-4da4-811e-eb1af566603d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:5c:54', 'vm-uuid': '9333a6d0-50a9-456a-8948-6f0f20ed8b45'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: INFO os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:54,bridge_name='br-int',has_traffic_filtering=True,id=ff69ee3b-5ba0-4da4-811e-eb1af566603d,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff69ee3b-5b')
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=5035b4ea-1ac0-45c7-a299-5277719d9fff,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5035b4ea-1a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=5035b4ea-1ac0-45c7-a299-5277719d9fff,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5035b4ea-1a') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5035b4ea-1a, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5035b4ea-1a, col_values=(('external_ids', {'iface-id': '5035b4ea-1ac0-45c7-a299-5277719d9fff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:f8:14', 'vm-uuid': '9333a6d0-50a9-456a-8948-6f0f20ed8b45'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: INFO os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=5035b4ea-1ac0-45c7-a299-5277719d9fff,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5035b4ea-1a')
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:56:87,bridge_name='br-int',has_traffic_filtering=True,id=6b64fd22-8774-490c-99cb-2f427c019ed5,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b64fd22-87') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:56:87,bridge_name='br-int',has_traffic_filtering=True,id=6b64fd22-8774-490c-99cb-2f427c019ed5,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b64fd22-87') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b64fd22-87, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b64fd22-87, col_values=(('external_ids', {'iface-id': '6b64fd22-8774-490c-99cb-2f427c019ed5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:56:87', 'vm-uuid': '9333a6d0-50a9-456a-8948-6f0f20ed8b45'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: INFO os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:56:87,bridge_name='br-int',has_traffic_filtering=True,id=6b64fd22-8774-490c-99cb-2f427c019ed5,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b64fd22-87')
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8d:82,bridge_name='br-int',has_traffic_filtering=True,id=40fb0fe9-3e51-4a07-89a4-67267cc274b3,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40fb0fe9-3e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8d:82,bridge_name='br-int',has_traffic_filtering=True,id=40fb0fe9-3e51-4a07-89a4-67267cc274b3,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40fb0fe9-3e') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40fb0fe9-3e, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40fb0fe9-3e, col_values=(('external_ids', {'iface-id': '40fb0fe9-3e51-4a07-89a4-67267cc274b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:8d:82', 'vm-uuid': '9333a6d0-50a9-456a-8948-6f0f20ed8b45'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: INFO os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8d:82,bridge_name='br-int',has_traffic_filtering=True,id=40fb0fe9-3e51-4a07-89a4-67267cc274b3,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40fb0fe9-3e')
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:73:5f,bridge_name='br-int',has_traffic_filtering=True,id=43e03d2b-f637-424a-837b-7fe1b7f5c87f,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e03d2b-f6') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:73:5f,bridge_name='br-int',has_traffic_filtering=True,id=43e03d2b-f637-424a-837b-7fe1b7f5c87f,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e03d2b-f6') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43e03d2b-f6, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43e03d2b-f6, col_values=(('external_ids', {'iface-id': '43e03d2b-f637-424a-837b-7fe1b7f5c87f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:73:5f', 'vm-uuid': '9333a6d0-50a9-456a-8948-6f0f20ed8b45'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: INFO os_vif [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:73:5f,bridge_name='br-int',has_traffic_filtering=True,id=43e03d2b-f637-424a-837b-7fe1b7f5c87f,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e03d2b-f6')
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] No BDM found with device name hda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] No VIF found with MAC fa:16:3e:08:44:e6, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] No VIF found with MAC fa:16:3e:19:56:87, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:08:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Using config drive
Aug 16 09:08:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:34 user nova-compute[73208]: INFO nova.compute.manager [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Attaching volume 20d34247-87f5-4a67-a19f-15f07e34e384 to /dev/vdb
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_brick.utils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[87311143-237c-42d3-b96a-92f50979abbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Snapshot image upload complete
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Creating config drive at /opt/stack/data/nova/instances/9333a6d0-50a9-456a-8948-6f0f20ed8b45/disk.config
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9333a6d0-50a9-456a-8948-6f0f20ed8b45/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj17x3xc0 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a9e7ea-ea5d-4c0f-aae8-5363a95f96cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[69331505-13bc-4614-a50a-a8c2c08d3714]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbabeb4-29bd-4502-8fc0-08b24311182f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9333a6d0-50a9-456a-8948-6f0f20ed8b45/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj17x3xc0" returned: 0 in 0.107s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:34 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38e3227-8531-469a-9984-265fdb1d4d9c]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:34 user nova-compute[73208]: INFO nova.compute.manager [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Shelve offloading
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG os_brick.utils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating existing volume attachment record: b96dd42f-a562-4cc9-8ebe-a7995ed5c5d3 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:08:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance destroyed successfully.
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquired lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:34 user nova-compute[73208]: DEBUG nova.network.neutron [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:08:35 user nova-compute[73208]: DEBUG nova.network.neutron [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Releasing lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance destroyed successfully.
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'resources' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-86453005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-86453005',id=2,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvQS8OkM6GCnnBI8vpSyzDNIWEWgT4Zn8HYodhu7szkC4i1yM7sLrd6tfpdIyvnrxwRg48+yftTDYkD1C5MKrNOy2sRzTHbubhSOoRIp/Sb2Lh31W/68eSiGtoRtQKFSg==',key_name='tempest-keypair-1433315580',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-22bku0a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member',shelved_at='2023-08-16T09:08:34.723538',shelved_host='user',shelved_image_id='a359a36c-319c-4d82-8dba-165429d8b00f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b78d27e-d22f-45a7-8fd4-0d0366fd68ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG os_vif [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bbaa277-29, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-43f71426-04ed-47d9-bffe-6cd10d9261e9 req-2858a94f-dd86-45cb-b3f0-91018ab959f3 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-changed-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-43f71426-04ed-47d9-bffe-6cd10d9261e9 req-2858a94f-dd86-45cb-b3f0-91018ab959f3 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Refreshing instance network info cache due to event network-changed-0bbaa277-2952-499a-9b56-e0dc09d81095. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-43f71426-04ed-47d9-bffe-6cd10d9261e9 req-2858a94f-dd86-45cb-b3f0-91018ab959f3 service nova] Acquiring lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-43f71426-04ed-47d9-bffe-6cd10d9261e9 req-2858a94f-dd86-45cb-b3f0-91018ab959f3 service nova] Acquired lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.network.neutron [req-43f71426-04ed-47d9-bffe-6cd10d9261e9 req-2858a94f-dd86-45cb-b3f0-91018ab959f3 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Refreshing network info cache for port 0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: INFO os_vif [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29')
Aug 16 09:08:36 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Deleting instance files /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad_del
Aug 16 09:08:36 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Deletion of /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad_del complete
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73208) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 09:08:36 user nova-compute[73208]: INFO nova.virt.libvirt.host [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] UEFI support detected
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Deleted allocations for instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad
Aug 16 09:08:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d5792c6-bc4c-475a-8a23-8ce6392a7053 req-2ea6668b-bbce-4e79-9baf-3c978bc60cd5 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5792c6-bc4c-475a-8a23-8ce6392a7053 req-2ea6668b-bbce-4e79-9baf-3c978bc60cd5 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5792c6-bc4c-475a-8a23-8ce6392a7053 req-2ea6668b-bbce-4e79-9baf-3c978bc60cd5 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5792c6-bc4c-475a-8a23-8ce6392a7053 req-2ea6668b-bbce-4e79-9baf-3c978bc60cd5 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d5792c6-bc4c-475a-8a23-8ce6392a7053 req-2ea6668b-bbce-4e79-9baf-3c978bc60cd5 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:36 user nova-compute[73208]: WARNING nova.compute.manager [req-3d5792c6-bc4c-475a-8a23-8ce6392a7053 req-2ea6668b-bbce-4e79-9baf-3c978bc60cd5 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 for instance with vm_state building and task_state spawning.
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.network.neutron [req-43f71426-04ed-47d9-bffe-6cd10d9261e9 req-2858a94f-dd86-45cb-b3f0-91018ab959f3 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updated VIF entry in instance network info cache for port 0bbaa277-2952-499a-9b56-e0dc09d81095. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG nova.network.neutron [req-43f71426-04ed-47d9-bffe-6cd10d9261e9 req-2858a94f-dd86-45cb-b3f0-91018ab959f3 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0bbaa277-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-43f71426-04ed-47d9-bffe-6cd10d9261e9 req-2858a94f-dd86-45cb-b3f0-91018ab959f3 service nova] Releasing lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-e23dc933-ce4a-45f8-909c-aee97b737461 req-ed8d0acf-cbe7-498b-a498-16d8ab914cf0 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e23dc933-ce4a-45f8-909c-aee97b737461 req-ed8d0acf-cbe7-498b-a498-16d8ab914cf0 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e23dc933-ce4a-45f8-909c-aee97b737461 req-ed8d0acf-cbe7-498b-a498-16d8ab914cf0 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e23dc933-ce4a-45f8-909c-aee97b737461 req-ed8d0acf-cbe7-498b-a498-16d8ab914cf0 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-e23dc933-ce4a-45f8-909c-aee97b737461 req-ed8d0acf-cbe7-498b-a498-16d8ab914cf0 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:37 user nova-compute[73208]: WARNING nova.compute.manager [req-e23dc933-ce4a-45f8-909c-aee97b737461 req-ed8d0acf-cbe7-498b-a498-16d8ab914cf0 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d for instance with vm_state building and task_state spawning.
Aug 16 09:08:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-02e40072-8fd2-4353-bba9-7e135ce8b72f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.204s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-58ed0711-5cc1-4f98-b329-3c10ce960f3f req-1f292fa9-0517-467f-a24f-9156eced22e2 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-58ed0711-5cc1-4f98-b329-3c10ce960f3f req-1f292fa9-0517-467f-a24f-9156eced22e2 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-58ed0711-5cc1-4f98-b329-3c10ce960f3f req-1f292fa9-0517-467f-a24f-9156eced22e2 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-58ed0711-5cc1-4f98-b329-3c10ce960f3f req-1f292fa9-0517-467f-a24f-9156eced22e2 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-58ed0711-5cc1-4f98-b329-3c10ce960f3f req-1f292fa9-0517-467f-a24f-9156eced22e2 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:38 user nova-compute[73208]: WARNING nova.compute.manager [req-58ed0711-5cc1-4f98-b329-3c10ce960f3f req-1f292fa9-0517-467f-a24f-9156eced22e2 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 for instance with vm_state building and task_state spawning.
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:38 user nova-compute[73208]: WARNING nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 for instance with vm_state building and task_state spawning.
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:38 user nova-compute[73208]: WARNING nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 for instance with vm_state building and task_state spawning.
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:38 user nova-compute[73208]: WARNING nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 for instance with vm_state building and task_state spawning.
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:38 user nova-compute[73208]: WARNING nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 for instance with vm_state building and task_state spawning.
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:38 user nova-compute[73208]: WARNING nova.compute.manager [req-97da4033-149c-4319-b8e3-a06060a9babb req-ba6d26b3-91ef-49c4-b8dc-9117594156fc service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 for instance with vm_state building and task_state spawning.
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:39 user nova-compute[73208]: WARNING nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d for instance with vm_state building and task_state spawning.
Aug 16 09:08:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:39 user nova-compute[73208]: WARNING nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff for instance with vm_state building and task_state spawning.
Aug 16 09:08:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:39 user nova-compute[73208]: WARNING nova.compute.manager [req-ee32c28a-cae9-4656-9827-beffd989963f req-a4afa96c-43b0-4432-a862-34a177cf1339 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff for instance with vm_state building and task_state spawning.
Aug 16 09:08:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLReFnSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:39 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:39 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:39 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f9d6b-0b1c-4a7b-8da6-76cbfab32d15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:08:39 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccefb7e-2c80-4392-836e-f0c527c9a8ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0] added
Aug 16 09:08:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e7a059-041f-46a5-af10-7249935a9d7d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce2c855-ce6c-48ff-a0da-1df01218cde7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLReFnSg {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLReFnSg" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6272732c-3fc4-4260-b86c-e0fad5e25fc6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aLReFnSg'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9418a8-23c3-4257-bf48-5b92914b39b8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acfe79d-8214-4ef6-a39d-3dd37ecf5746]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[849dacdd-328f-400b-9cb5-420e93cd7813]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0, portal: 172.16.0.220,3260]
Aug 16 09:08:39 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0, portal: 172.16.0.220,3260] successful.
Aug 16 09:08:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd4bf8d-22bc-40d1-826d-4691c42d2e7b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e7f61-f87b-494a-bacf-cf5c96014331]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 (non-flash)
Aug 16 09:08:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[00531b72-9b32-4f09-975f-d043682cb3af]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:40 user nova-compute[73208]: WARNING nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 for instance with vm_state building and task_state spawning.
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:40 user nova-compute[73208]: WARNING nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f for instance with vm_state building and task_state spawning.
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:40 user nova-compute[73208]: WARNING nova.compute.manager [req-9418b8d0-8a08-44d3-88a7-bf2a979461a0 req-aca85289-f44f-4cdd-a30a-643f7b273e5a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f for instance with vm_state building and task_state spawning.
Aug 16 09:08:40 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLReFnSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23332326236306233', 'path': '/dev/sdf'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332326236306233', 'path': '/dev/sdf'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lazy-loading 'flavor' on Instance uuid ee15c9d4-1895-4afa-bd25-d21098b0ca34 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:08:40 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:08:40 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:08:40 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:08:40 user nova-compute[73208]:   <serial>3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0</serial>
Aug 16 09:08:40 user nova-compute[73208]: </disk>
Aug 16 09:08:40 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176920.7884097, 9333a6d0-50a9-456a-8948-6f0f20ed8b45 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:08:40 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] VM Resumed (Lifecycle Event)
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:08:40 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance spawned successfully.
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:08:40 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692176920.793925, 9333a6d0-50a9-456a-8948-6f0f20ed8b45 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:08:40 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] VM Started (Lifecycle Event)
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:08:40 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:08:40 user nova-compute[73208]: INFO nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Took 12.32 seconds to spawn the instance on the hypervisor.
Aug 16 09:08:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:41 user nova-compute[73208]: INFO nova.compute.manager [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Took 49.24 seconds to build instance.
Aug 16 09:08:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3c053fd-5a01-4172-a98f-af105d6ee941 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.373s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:08:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:08:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] No VIF found with MAC fa:16:3e:4b:63:21, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:08:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4531d01-4e9a-45c4-8192-0356bc18eb18 tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.523s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:42 user nova-compute[73208]: INFO nova.compute.manager [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Terminating instance
Aug 16 09:08:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-2c0e1c85-3269-4aba-9f01-4b3e1fb086b2 req-60277954-316f-4966-b0d8-b0e86f5cccd5 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received event network-vif-unplugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2c0e1c85-3269-4aba-9f01-4b3e1fb086b2 req-60277954-316f-4966-b0d8-b0e86f5cccd5 service nova] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2c0e1c85-3269-4aba-9f01-4b3e1fb086b2 req-60277954-316f-4966-b0d8-b0e86f5cccd5 service nova] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2c0e1c85-3269-4aba-9f01-4b3e1fb086b2 req-60277954-316f-4966-b0d8-b0e86f5cccd5 service nova] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-2c0e1c85-3269-4aba-9f01-4b3e1fb086b2 req-60277954-316f-4966-b0d8-b0e86f5cccd5 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] No waiting events found dispatching network-vif-unplugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-2c0e1c85-3269-4aba-9f01-4b3e1fb086b2 req-60277954-316f-4966-b0d8-b0e86f5cccd5 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received event network-vif-unplugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:08:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Instance destroyed successfully.
Aug 16 09:08:42 user nova-compute[73208]: DEBUG nova.objects.instance [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lazy-loading 'resources' on Instance uuid ee15c9d4-1895-4afa-bd25-d21098b0ca34 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1226920265',display_name='tempest-DeleteServersTestJSON-server-1226920265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1226920265',id=1,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a73ed43465f748bbb8b91467184ce41c',ramdisk_id='',reservation_id='r-4ilu0pbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1038611982',owner_user_name='tempest-DeleteServersTestJSON-1038611982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:06:54Z,user_data=None,user_id='ddf1f606b0a64c56a99a13f34f2bb159',uuid=ee15c9d4-1895-4afa-bd25-d21098b0ca34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Converting VIF {"id": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "address": "fa:16:3e:4b:63:21", "network": {"id": "6f74347e-6883-478d-83c8-987d3d22c22d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1996555829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73ed43465f748bbb8b91467184ce41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7b3495-6e", "ovs_interfaceid": "2b7b3495-6e5d-458a-a3ee-720b6ed38b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:63:21,bridge_name='br-int',has_traffic_filtering=True,id=2b7b3495-6e5d-458a-a3ee-720b6ed38b9f,network=Network(6f74347e-6883-478d-83c8-987d3d22c22d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7b3495-6e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_vif [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:63:21,bridge_name='br-int',has_traffic_filtering=True,id=2b7b3495-6e5d-458a-a3ee-720b6ed38b9f,network=Network(6f74347e-6883-478d-83c8-987d3d22c22d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7b3495-6e') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b7b3495-6e, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:43 user nova-compute[73208]: INFO os_vif [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:63:21,bridge_name='br-int',has_traffic_filtering=True,id=2b7b3495-6e5d-458a-a3ee-720b6ed38b9f,network=Network(6f74347e-6883-478d-83c8-987d3d22c22d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7b3495-6e')
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLReFnSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:43 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab84e356-37f7-4334-a34d-0494cab5e88b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a3e6a0-52b9-440d-b02f-bc0da3da2303]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:43 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:43 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:43 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:08:43 user nova-compute[73208]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 (non-flash)
Aug 16 09:08:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:08:43 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:08:43 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:08:43 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:08:43 user nova-compute[73208]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 (non-flash)
Aug 16 09:08:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f01f9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0'): ({'sdf'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Removing single pathed devices sdf {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec2fbc-55be-4c3e-889a-3c127bb5610a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9816f66c-a88a-4597-85c4-a7a5910505e0]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Flushing IO for device /dev/sdf {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad4d5f-060e-4a7d-bccc-522f6608e03e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5c8a63-4a3f-4011-8b87-290642c517d7]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa26e10-cbbb-4c76-99ab-c7a8d3bfe489]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345586a-84cb-4172-bd4f-25f3cdc01592]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0, portal: 172.16.0.220,3260]
Aug 16 09:08:43 user nova-compute[73208]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0, portal: 172.16.0.220,3260] successful.
Aug 16 09:08:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ee4e5c8-0917-4984-9b38-8ce22a0ff5f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7a1f34-b066-40f7-a84e-4bea779a6f86]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] <== disconnect_volume: return (305ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:08:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Deleting instance files /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34_del
Aug 16 09:08:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Deletion of /opt/stack/data/nova/instances/ee15c9d4-1895-4afa-bd25-d21098b0ca34_del complete
Aug 16 09:08:43 user nova-compute[73208]: INFO nova.compute.manager [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-e5a839f8-cf78-4df4-bc48-02a3073a6edd req-812ea24e-547b-4adb-8b3c-d9b9e0a88476 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received event network-changed-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-e5a839f8-cf78-4df4-bc48-02a3073a6edd req-812ea24e-547b-4adb-8b3c-d9b9e0a88476 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Refreshing instance network info cache due to event network-changed-d6f60e94-e3b7-45e1-a723-fb9c7250902e. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e5a839f8-cf78-4df4-bc48-02a3073a6edd req-812ea24e-547b-4adb-8b3c-d9b9e0a88476 service nova] Acquiring lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e5a839f8-cf78-4df4-bc48-02a3073a6edd req-812ea24e-547b-4adb-8b3c-d9b9e0a88476 service nova] Acquired lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:43 user nova-compute[73208]: DEBUG nova.network.neutron [req-e5a839f8-cf78-4df4-bc48-02a3073a6edd req-812ea24e-547b-4adb-8b3c-d9b9e0a88476 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Refreshing network info cache for port d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-c4f23acb-133d-4fd9-8fc4-2ac840c15a10 req-b1b25287-dc01-4bc7-96f5-c59bbbeb8cb3 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received event network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c4f23acb-133d-4fd9-8fc4-2ac840c15a10 req-b1b25287-dc01-4bc7-96f5-c59bbbeb8cb3 service nova] Acquiring lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c4f23acb-133d-4fd9-8fc4-2ac840c15a10 req-b1b25287-dc01-4bc7-96f5-c59bbbeb8cb3 service nova] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c4f23acb-133d-4fd9-8fc4-2ac840c15a10 req-b1b25287-dc01-4bc7-96f5-c59bbbeb8cb3 service nova] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-c4f23acb-133d-4fd9-8fc4-2ac840c15a10 req-b1b25287-dc01-4bc7-96f5-c59bbbeb8cb3 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] No waiting events found dispatching network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:44 user nova-compute[73208]: WARNING nova.compute.manager [req-c4f23acb-133d-4fd9-8fc4-2ac840c15a10 req-b1b25287-dc01-4bc7-96f5-c59bbbeb8cb3 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received unexpected event network-vif-plugged-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f for instance with vm_state active and task_state deleting.
Aug 16 09:08:44 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:44 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Took 1.43 seconds to deallocate network for instance.
Aug 16 09:08:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-e5a839f8-cf78-4df4-bc48-02a3073a6edd req-812ea24e-547b-4adb-8b3c-d9b9e0a88476 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Updated VIF entry in instance network info cache for port d6f60e94-e3b7-45e1-a723-fb9c7250902e. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-e5a839f8-cf78-4df4-bc48-02a3073a6edd req-812ea24e-547b-4adb-8b3c-d9b9e0a88476 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Updating instance_info_cache with network_info: [{"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e5a839f8-cf78-4df4-bc48-02a3073a6edd req-812ea24e-547b-4adb-8b3c-d9b9e0a88476 service nova] Releasing lock "refresh_cache-84819dea-4fd7-44cd-83a1-10e62263edca" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:45 user nova-compute[73208]: INFO nova.compute.manager [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Took 0.93 seconds to detach 1 volumes for instance.
Aug 16 09:08:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-b4a5754b-459e-4b88-9274-d8785baba41f req-f72af905-b2d6-4241-b25c-a0322b326b23 service nova] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Received event network-vif-deleted-2b7b3495-6e5d-458a-a3ee-720b6ed38b9f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:45 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692176910.8906388, 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:08:45 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] VM Stopped (Lifecycle Event)
Aug 16 09:08:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0e71e19b-9583-42a9-8d7e-75d0d5bb829a None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:46 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:08:46 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:08:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:46 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Deleted allocations for instance ee15c9d4-1895-4afa-bd25-d21098b0ca34
Aug 16 09:08:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9a006dc3-589e-4548-b1d4-bee46435446f tempest-DeleteServersTestJSON-1038611982 tempest-DeleteServersTestJSON-1038611982-project-member] Lock "ee15c9d4-1895-4afa-bd25-d21098b0ca34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.221s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:48 user nova-compute[73208]: DEBUG nova.objects.instance [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lazy-loading 'flavor' on Instance uuid 84819dea-4fd7-44cd-83a1-10e62263edca {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:48 user nova-compute[73208]: INFO nova.compute.manager [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Attaching volume 7ae1da55-4df6-4cce-99d8-df0f3993ee93 to /dev/sdc
Aug 16 09:08:48 user nova-compute[73208]: DEBUG os_brick.utils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80a1e86-2c6f-4344-afb7-42b74304f2f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad7b095-3b86-4f2f-bf3a-9e5cad90992b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69d7d7-6f44-4fa4-a947-abac56fdfcb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5cf64d-2368-4557-85fd-04cdd5386e4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:49 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:08:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b68f8c5-e886-426c-b65d-b7b6bbe27bda]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG os_brick.utils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Updating existing volume attachment record: 45ca0d07-40ff-4b4c-8d4a-373bd84f5430 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:08:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-6f78a8d6-7c0f-43df-aa97-a71d1814b8ca req-8e7e909c-2ec5-42a5-935d-ea118979ef23 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-changed-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-6f78a8d6-7c0f-43df-aa97-a71d1814b8ca req-8e7e909c-2ec5-42a5-935d-ea118979ef23 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Refreshing instance network info cache due to event network-changed-19a387ca-2e14-4170-947a-5f2b5f1f9bf1. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6f78a8d6-7c0f-43df-aa97-a71d1814b8ca req-8e7e909c-2ec5-42a5-935d-ea118979ef23 service nova] Acquiring lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6f78a8d6-7c0f-43df-aa97-a71d1814b8ca req-8e7e909c-2ec5-42a5-935d-ea118979ef23 service nova] Acquired lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:51 user nova-compute[73208]: DEBUG nova.network.neutron [req-6f78a8d6-7c0f-43df-aa97-a71d1814b8ca req-8e7e909c-2ec5-42a5-935d-ea118979ef23 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Refreshing network info cache for port 19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-6f78a8d6-7c0f-43df-aa97-a71d1814b8ca req-8e7e909c-2ec5-42a5-935d-ea118979ef23 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updated VIF entry in instance network info cache for port 19a387ca-2e14-4170-947a-5f2b5f1f9bf1. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-6f78a8d6-7c0f-43df-aa97-a71d1814b8ca req-8e7e909c-2ec5-42a5-935d-ea118979ef23 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "interface-341d90a7-086a-42ce-9c23-d3422883d13e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "interface-341d90a7-086a-42ce-9c23-d3422883d13e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'flavor' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6f78a8d6-7c0f-43df-aa97-a71d1814b8ca req-8e7e909c-2ec5-42a5-935d-ea118979ef23 service nova] Releasing lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'pci_requests' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:08:52 user nova-compute[73208]: DEBUG nova.policy [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47c19f8b4a714169ba98d35d751dafd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a0d6bce9943868579b6b88a526f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:08:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Successfully created port: 2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Successfully updated port: 2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquired lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-20f5d413-0645-49b1-b0c3-2fed697d435e req-19727a23-04a7-4af1-896d-65abf5fa4f47 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-changed-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-20f5d413-0645-49b1-b0c3-2fed697d435e req-19727a23-04a7-4af1-896d-65abf5fa4f47 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Refreshing instance network info cache due to event network-changed-2a212149-e8a4-4161-8258-81abbe2861e5. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-20f5d413-0645-49b1-b0c3-2fed697d435e req-19727a23-04a7-4af1-896d-65abf5fa4f47 service nova] Acquiring lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-e0467794-d287-458c-a57d-fb376189d7dc req-b1287e89-ba59-4a3c-ae73-a77459f201e2 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received event network-changed-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-e0467794-d287-458c-a57d-fb376189d7dc req-b1287e89-ba59-4a3c-ae73-a77459f201e2 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Refreshing instance network info cache due to event network-changed-d5f33513-9c06-4d4c-80ae-96d56600b971. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e0467794-d287-458c-a57d-fb376189d7dc req-b1287e89-ba59-4a3c-ae73-a77459f201e2 service nova] Acquiring lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e0467794-d287-458c-a57d-fb376189d7dc req-b1287e89-ba59-4a3c-ae73-a77459f201e2 service nova] Acquired lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-e0467794-d287-458c-a57d-fb376189d7dc req-b1287e89-ba59-4a3c-ae73-a77459f201e2 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Refreshing network info cache for port d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG nova.objects.instance [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lazy-loading 'flavor' on Instance uuid 77d077df-579d-4d9d-b76b-14d5d0a0d26f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:54 user nova-compute[73208]: INFO nova.compute.manager [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Attaching volume 727678eb-0ad9-4072-863e-3b021744941f to /dev/vdb
Aug 16 09:08:54 user nova-compute[73208]: DEBUG os_brick.utils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc546795-6b0b-416d-8281-020fe3786d5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eb3b55-09ef-474f-8664-04682e3979ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda26154-efb7-4c2f-89d3-d20bc23e2f81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b769f-0950-4026-90c2-509d0d2bafff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:08:55 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[67011ce9-a2e3-4c92-8f82-69947e633bc8]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG os_brick.utils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Updating existing volume attachment record: f11fd620-b376-4a7a-9d64-a40cb3943ff7 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.neutron [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.neutron [req-e0467794-d287-458c-a57d-fb376189d7dc req-b1287e89-ba59-4a3c-ae73-a77459f201e2 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Updated VIF entry in instance network info cache for port d5f33513-9c06-4d4c-80ae-96d56600b971. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.neutron [req-e0467794-d287-458c-a57d-fb376189d7dc req-b1287e89-ba59-4a3c-ae73-a77459f201e2 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Updating instance_info_cache with network_info: [{"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Releasing lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e0467794-d287-458c-a57d-fb376189d7dc req-b1287e89-ba59-4a3c-ae73-a77459f201e2 service nova] Releasing lock "refresh_cache-77d077df-579d-4d9d-b76b-14d5d0a0d26f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-20f5d413-0645-49b1-b0c3-2fed697d435e req-19727a23-04a7-4af1-896d-65abf5fa4f47 service nova] Acquired lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.neutron [req-20f5d413-0645-49b1-b0c3-2fed697d435e req-19727a23-04a7-4af1-896d-65abf5fa4f47 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Refreshing network info cache for port 2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converting VIF {"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG os_vif [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a212149-e8, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a212149-e8, col_values=(('external_ids', {'iface-id': '2a212149-e8a4-4161-8258-81abbe2861e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:73:1a', 'vm-uuid': '341d90a7-086a-42ce-9c23-d3422883d13e'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: INFO os_vif [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8')
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converting VIF {"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] attach device xml: <interface type="ethernet">
Aug 16 09:08:55 user nova-compute[73208]:   <mac address="fa:16:3e:00:73:1a"/>
Aug 16 09:08:55 user nova-compute[73208]:   <model type="virtio"/>
Aug 16 09:08:55 user nova-compute[73208]:   <mtu size="1442"/>
Aug 16 09:08:55 user nova-compute[73208]:   <target dev="tap2a212149-e8"/>
Aug 16 09:08:55 user nova-compute[73208]: </interface>
Aug 16 09:08:55 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No BDM found with device name hda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No VIF found with MAC fa:16:3e:c2:f8:7f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.neutron [req-20f5d413-0645-49b1-b0c3-2fed697d435e req-19727a23-04a7-4af1-896d-65abf5fa4f47 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updated VIF entry in instance network info cache for port 2a212149-e8a4-4161-8258-81abbe2861e5. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.network.neutron [req-20f5d413-0645-49b1-b0c3-2fed697d435e req-19727a23-04a7-4af1-896d-65abf5fa4f47 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-20f5d413-0645-49b1-b0c3-2fed697d435e req-19727a23-04a7-4af1-896d-65abf5fa4f47 service nova] Releasing lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:08:55 user nova-compute[73208]:   <nova:package version="0.0.0"/>
Aug 16 09:08:55 user nova-compute[73208]:   <nova:name>tempest-device-tagging-server-618417393</nova:name>
Aug 16 09:08:55 user nova-compute[73208]:   <nova:creationTime>2023-08-16 09:08:55</nova:creationTime>
Aug 16 09:08:55 user nova-compute[73208]:   <nova:flavor name="m1.tiny">
Aug 16 09:08:55 user nova-compute[73208]:     <nova:memory>512</nova:memory>
Aug 16 09:08:55 user nova-compute[73208]:     <nova:disk>1</nova:disk>
Aug 16 09:08:55 user nova-compute[73208]:     <nova:swap>0</nova:swap>
Aug 16 09:08:55 user nova-compute[73208]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:08:55 user nova-compute[73208]:     <nova:vcpus>1</nova:vcpus>
Aug 16 09:08:55 user nova-compute[73208]:   </nova:flavor>
Aug 16 09:08:55 user nova-compute[73208]:   <nova:owner>
Aug 16 09:08:55 user nova-compute[73208]:     <nova:user uuid="47c19f8b4a714169ba98d35d751dafd7">tempest-TaggedAttachmentsTest-2091015158-project-member</nova:user>
Aug 16 09:08:55 user nova-compute[73208]:     <nova:project uuid="293a0d6bce9943868579b6b88a526f2b">tempest-TaggedAttachmentsTest-2091015158</nova:project>
Aug 16 09:08:55 user nova-compute[73208]:   </nova:owner>
Aug 16 09:08:55 user nova-compute[73208]:   <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:08:55 user nova-compute[73208]:   <nova:ports>
Aug 16 09:08:55 user nova-compute[73208]:     <nova:port uuid="19a387ca-2e14-4170-947a-5f2b5f1f9bf1">
Aug 16 09:08:55 user nova-compute[73208]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:08:55 user nova-compute[73208]:     </nova:port>
Aug 16 09:08:55 user nova-compute[73208]:     <nova:port uuid="2a212149-e8a4-4161-8258-81abbe2861e5">
Aug 16 09:08:55 user nova-compute[73208]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Aug 16 09:08:55 user nova-compute[73208]:     </nova:port>
Aug 16 09:08:55 user nova-compute[73208]:   </nova:ports>
Aug 16 09:08:55 user nova-compute[73208]: </nova:instance>
Aug 16 09:08:55 user nova-compute[73208]:  {{(pid=73208) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-20be122b-4f31-4612-b2a1-69d774a2251e tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "interface-341d90a7-086a-42ce-9c23-d3422883d13e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.599s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] No waiting events found dispatching network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:56 user nova-compute[73208]: WARNING nova.compute.manager [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received unexpected event network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 for instance with vm_state active and task_state None.
Aug 16 09:08:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:08:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] No waiting events found dispatching network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:08:56 user nova-compute[73208]: WARNING nova.compute.manager [req-78ea3fd6-973a-444a-bd46-a382b8318889 req-d03956c4-08e8-47e6-858a-84522df7e8c4 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received unexpected event network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 for instance with vm_state active and task_state None.
Aug 16 09:08:57 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692176922.9795835, ee15c9d4-1895-4afa-bd25-d21098b0ca34 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:08:57 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] VM Stopped (Lifecycle Event)
Aug 16 09:08:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-21d1becf-6e3e-4f05-b1de-7bc8c6d027e1 None None] [instance: ee15c9d4-1895-4afa-bd25-d21098b0ca34] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:08:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZelrEXnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:00 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:00 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:00 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2617c-f5a6-4d46-9714-49a087ab78a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:09:00 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[573dbd2a-c120-4c59-9d2f-d68151153805]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93] added
Aug 16 09:09:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbd9c83-0e66-474b-b87a-4813b427edfc]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d1b30c-2e0d-445d-918a-bf0f493ff66e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZelrEXnC {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZelrEXnC" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f7843-9d7f-443b-8e32-c82310a583dd]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZelrEXnC'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab5fa4e-d689-417e-b62f-6a7e883244e6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[224fa8fc-92d9-4c70-8794-0fe191c8dcc5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG nova.objects.instance [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'flavor' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --login" returned: 0 in 0.191s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e3bf5c-74e2-4cd8-a1b2-e71b322ac71a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93, portal: 172.16.0.220,3260]
Aug 16 09:09:01 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:01 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6e9781-3ac8-49ed-ba69-d391b8a01b92]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:01 user nova-compute[73208]: INFO nova.compute.manager [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Attaching volume 12d07bae-3892-4786-ac4e-c0d10a492e94 to /dev/vdb
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ef1a46-ddc8-4d79-98da-7ab926fcd8d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)
Aug 16 09:09:01 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9609b967-fde4-48f2-8384-09a48f9a9d9a]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.utils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f94ab79-dfcf-410e-9a09-ce88d30b2756]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90f1982-b63c-4069-bd30-46e5d03e44b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c5fed1-bed1-4c4a-be16-2aebe59c0d14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4fefd4-99f1-4799-90f8-f37fbd680f30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:09:01 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:09:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc75426b-bd46-4678-8dba-080e9f928cd9]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG os_brick.utils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:01 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating existing volume attachment record: 7e12f229-911a-4bd5-91a4-d7f0a98631b9 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZelrEXnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '23036653938616130', 'path': '/dev/sdf'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036653938616130', 'path': '/dev/sdf'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG nova.objects.instance [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lazy-loading 'flavor' on Instance uuid 84819dea-4fd7-44cd-83a1-10e62263edca {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:09:02 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:02 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:09:02 user nova-compute[73208]:   <target dev="sdc" bus="scsi"/>
Aug 16 09:09:02 user nova-compute[73208]:   <serial>7ae1da55-4df6-4cce-99d8-df0f3993ee93</serial>
Aug 16 09:09:02 user nova-compute[73208]:   <address type="drive" controller="0" unit="2"/>
Aug 16 09:09:02 user nova-compute[73208]: </disk>
Aug 16 09:09:02 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] No BDM found with device name sda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] No VIF found with MAC fa:16:3e:80:93:b1, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:09:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Iifrawxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:05 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:05 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:05 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[07004ec1-e29d-4cf6-96a2-079189208ff4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:09:05 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68161c0-f563-47d8-9760-2329634a65e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384] added
Aug 16 09:09:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a320d6-3d98-4c1e-9032-1dc8fcc63549]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[decf388b-f5e9-49fe-bc27-8cea58a222fd]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Iifrawxd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Iifrawxd" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b7ee0-eca8-4fbc-8521-eb4f2cea6a0f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Iifrawxd'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7dd23-9bae-4277-8316-7582de0ba1d3]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e437dd6-bc3e-4c26-8c29-86b3f4c9800e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[897fcf11-af89-4306-9f56-0f2b37248b19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260]
Aug 16 09:09:05 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e2626d-b4ba-4f52-945c-1cfd667ae7e9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[171592d2-3619-4358-b7ba-c7ef5757fd74]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-748416ea-27d5-4f65-b222-ebe87cd00d16 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.553s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[926fa5b6-f599-4c12-b141-24e3a0826973]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:09:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Iifrawxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:09:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23937323262386635', 'path': '/dev/sdg'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937323262386635', 'path': '/dev/sdg'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:09:06 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:09:06 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:06 user nova-compute[73208]:   <source dev="/dev/sdg"/>
Aug 16 09:09:06 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:09:06 user nova-compute[73208]:   <serial>20d34247-87f5-4a67-a19f-15f07e34e384</serial>
Aug 16 09:09:06 user nova-compute[73208]: </disk>
Aug 16 09:09:06 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:09:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:06 user nova-compute[73208]: INFO nova.compute.manager [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Detaching volume 7ae1da55-4df6-4cce-99d8-df0f3993ee93
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No VIF found with MAC fa:16:3e:28:fe:95, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:09:07 user nova-compute[73208]: INFO nova.virt.block_device [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Attempting to driver detach volume 7ae1da55-4df6-4cce-99d8-df0f3993ee93 from mountpoint /dev/sdc
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Attempting to detach device sdc from instance 84819dea-4fd7-44cd-83a1-10e62263edca from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:09:07 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:07 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:09:07 user nova-compute[73208]:   <target dev="sdc" bus="scsi"/>
Aug 16 09:09:07 user nova-compute[73208]:   <serial>7ae1da55-4df6-4cce-99d8-df0f3993ee93</serial>
Aug 16 09:09:07 user nova-compute[73208]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 09:09:07 user nova-compute[73208]: </disk>
Aug 16 09:09:07 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:09:07 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Successfully detached device sdc from instance 84819dea-4fd7-44cd-83a1-10e62263edca from the persistent domain config.
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 84819dea-4fd7-44cd-83a1-10e62263edca from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:09:07 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:07 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:09:07 user nova-compute[73208]:   <target dev="sdc" bus="scsi"/>
Aug 16 09:09:07 user nova-compute[73208]:   <serial>7ae1da55-4df6-4cce-99d8-df0f3993ee93</serial>
Aug 16 09:09:07 user nova-compute[73208]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 09:09:07 user nova-compute[73208]: </disk>
Aug 16 09:09:07 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6578df3a-d8f7-46e8-a864-763d29e9c53a tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.597s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692176947.4619155, 84819dea-4fd7-44cd-83a1-10e62263edca => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 84819dea-4fd7-44cd-83a1-10e62263edca {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:09:07 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Successfully detached device sdc from instance 84819dea-4fd7-44cd-83a1-10e62263edca from the live domain config.
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZelrEXnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:07 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59d4fcd-179f-4dde-b0cd-0571e419ea2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6fe3fc-1b8b-4821-92a3-2f9bc7539920]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 (non-flash)
Aug 16 09:09:07 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f0040ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93'): ({'sdf'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Removing single pathed devices sdf {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef18029f-4e66-44a0-9e67-48e8ad4ddad8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f843888-ca51-4782-a819-045731115647]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Flushing IO for device /dev/sdf {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[120d4116-28e2-4027-b298-c1abc9e4c7fe]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5ee5f-a4b0-4817-89cd-47d417cfcad3]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88d3f9d-a275-4281-b547-684359be0e83]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f51b29-0882-4f02-b30c-e125a9847d66]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93, portal: 172.16.0.220,3260]
Aug 16 09:09:07 user nova-compute[73208]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bfc1ad81-19e0-4b38-8e34-735df5da0184 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bfc1ad81-19e0-4b38-8e34-735df5da0184 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bfc1ad81-19e0-4b38-8e34-735df5da0184 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bfc1ad81-19e0-4b38-8e34-735df5da0184 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73208) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.objects.instance [None req-bfc1ad81-19e0-4b38-8e34-735df5da0184 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae1da55-4df6-4cce-99d8-df0f3993ee93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5838f3-d61f-4088-b405-1ed18b969042]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] <== disconnect_volume: return (341ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-6e82486d-890b-4469-9e61-bc7783b87312 req-3f03fd8b-84d3-42d6-93aa-4bca268edb94 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e82486d-890b-4469-9e61-bc7783b87312 req-3f03fd8b-84d3-42d6-93aa-4bca268edb94 service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e82486d-890b-4469-9e61-bc7783b87312 req-3f03fd8b-84d3-42d6-93aa-4bca268edb94 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e82486d-890b-4469-9e61-bc7783b87312 req-3f03fd8b-84d3-42d6-93aa-4bca268edb94 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-6e82486d-890b-4469-9e61-bc7783b87312 req-3f03fd8b-84d3-42d6-93aa-4bca268edb94 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:08 user nova-compute[73208]: WARNING nova.compute.manager [req-6e82486d-890b-4469-9e61-bc7783b87312 req-3f03fd8b-84d3-42d6-93aa-4bca268edb94 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state active and task_state powering-off.
Aug 16 09:09:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance destroyed successfully.
Aug 16 09:09:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bfc1ad81-19e0-4b38-8e34-735df5da0184 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:09:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bfc1ad81-19e0-4b38-8e34-735df5da0184 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.041s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-3e64a6b7-7ba0-4fa0-a0f6-735aa508753f req-8cdf892b-7bbc-414b-a7ba-53d48c2d080b service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3e64a6b7-7ba0-4fa0-a0f6-735aa508753f req-8cdf892b-7bbc-414b-a7ba-53d48c2d080b service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3e64a6b7-7ba0-4fa0-a0f6-735aa508753f req-8cdf892b-7bbc-414b-a7ba-53d48c2d080b service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3e64a6b7-7ba0-4fa0-a0f6-735aa508753f req-8cdf892b-7bbc-414b-a7ba-53d48c2d080b service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-3e64a6b7-7ba0-4fa0-a0f6-735aa508753f req-8cdf892b-7bbc-414b-a7ba-53d48c2d080b service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:10 user nova-compute[73208]: WARNING nova.compute.manager [req-3e64a6b7-7ba0-4fa0-a0f6-735aa508753f req-8cdf892b-7bbc-414b-a7ba-53d48c2d080b service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state stopped and task_state None.
Aug 16 09:09:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:12 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lazy-loading 'flavor' on Instance uuid 84819dea-4fd7-44cd-83a1-10e62263edca {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee1a76de-02be-4698-a7ec-ac4365fb322b tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.976s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:13 user nova-compute[73208]: INFO nova.compute.manager [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Terminating instance
Aug 16 09:09:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG nova.compute.manager [req-80ea1c9d-8275-474c-9192-732f01be6ee1 req-44f1d078-6560-462d-878e-0ae3223a602c service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received event network-vif-unplugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80ea1c9d-8275-474c-9192-732f01be6ee1 req-44f1d078-6560-462d-878e-0ae3223a602c service nova] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80ea1c9d-8275-474c-9192-732f01be6ee1 req-44f1d078-6560-462d-878e-0ae3223a602c service nova] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80ea1c9d-8275-474c-9192-732f01be6ee1 req-44f1d078-6560-462d-878e-0ae3223a602c service nova] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG nova.compute.manager [req-80ea1c9d-8275-474c-9192-732f01be6ee1 req-44f1d078-6560-462d-878e-0ae3223a602c service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] No waiting events found dispatching network-vif-unplugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:13 user nova-compute[73208]: DEBUG nova.compute.manager [req-80ea1c9d-8275-474c-9192-732f01be6ee1 req-44f1d078-6560-462d-878e-0ae3223a602c service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received event network-vif-unplugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:14 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Instance destroyed successfully.
Aug 16 09:09:14 user nova-compute[73208]: DEBUG nova.objects.instance [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lazy-loading 'resources' on Instance uuid 84819dea-4fd7-44cd-83a1-10e62263edca {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-684298365',display_name='tempest-AttachSCSIVolumeTestJSON-server-684298365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-684298365',id=6,image_ref='c7ee566b-9a64-4316-bbe3-f1d6302a83a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKPO6IsESor397ravis1ugTUcdyYDMePBP+m2noJjgi4v3NKDS+RHPFzxlXvKbkhX7vSJvJb1XKDRphvIu7rmhKrKfhFscTcr4YDLcHWbCaY9ZfpBte/htkouJL3QEF3A==',key_name='tempest-keypair-1532475214',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7afa4095799f45b98e936186595269f4',ramdisk_id='',reservation_id='r-0s1qcm5j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ee566b-9a64-4316-bbe3-f1d6302a83a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1469266961',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1469266961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d651256cbca74403b5d1b4f574dcaa16',uuid=84819dea-4fd7-44cd-83a1-10e62263edca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Converting VIF {"id": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "address": "fa:16:3e:80:93:b1", "network": {"id": "ac955168-4318-4cc2-b694-0c0b36b96667", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1757369515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7afa4095799f45b98e936186595269f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f60e94-e3", "ovs_interfaceid": "d6f60e94-e3b7-45e1-a723-fb9c7250902e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:93:b1,bridge_name='br-int',has_traffic_filtering=True,id=d6f60e94-e3b7-45e1-a723-fb9c7250902e,network=Network(ac955168-4318-4cc2-b694-0c0b36b96667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f60e94-e3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_vif [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:93:b1,bridge_name='br-int',has_traffic_filtering=True,id=d6f60e94-e3b7-45e1-a723-fb9c7250902e,network=Network(ac955168-4318-4cc2-b694-0c0b36b96667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f60e94-e3') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6f60e94-e3, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:14 user nova-compute[73208]: INFO os_vif [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:93:b1,bridge_name='br-int',has_traffic_filtering=True,id=d6f60e94-e3b7-45e1-a723-fb9c7250902e,network=Network(ac955168-4318-4cc2-b694-0c0b36b96667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f60e94-e3')
Aug 16 09:09:14 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Deleting instance files /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca_del
Aug 16 09:09:14 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Deletion of /opt/stack/data/nova/instances/84819dea-4fd7-44cd-83a1-10e62263edca_del complete
Aug 16 09:09:14 user nova-compute[73208]: INFO nova.compute.manager [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BADTbFch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:14 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:14 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:14 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d506d83a-b37b-4f64-98d2-b5139e2eb0c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:09:14 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b877f39-0007-4cce-b099-d8998a3bc3e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f] added
Aug 16 09:09:14 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d6978c-e6b5-4902-9414-7a59fbb17637]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[60939a0c-59bb-4c48-a0ce-efbba0b50cde]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BADTbFch {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BADTbFch" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5ae687-befa-446e-87fb-f2501104bf0d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BADTbFch'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6048b771-3695-40e1-a621-ce629c32fe5e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5397a22a-87b7-44b3-8b6e-fdc0cc1df8b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:14 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:14 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:14 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:14 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:14 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:14 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:14 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:14 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:14 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:14 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1793c0b-6429-473e-8849-1d32e3be32f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f, portal: 172.16.0.220,3260]
Aug 16 09:09:15 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:15 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a0f66a-54b6-47ce-b164-f17f7bc6ef7a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[05559b0d-7c54-4858-b10e-11e8f5ca434a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f (non-flash)
Aug 16 09:09:15 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:15 user nova-compute[73208]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f (non-flash)
Aug 16 09:09:15 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee1d5c8-6610-4de1-a082-7f32e55cc07b]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:15 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Took 1.37 seconds to deallocate network for instance.
Aug 16 09:09:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-8fa93586-5920-4e3a-9911-268b4a0cc106 req-aa3a7045-64b6-4dfd-baaa-d9f989f82d38 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received event network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8fa93586-5920-4e3a-9911-268b4a0cc106 req-aa3a7045-64b6-4dfd-baaa-d9f989f82d38 service nova] Acquiring lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8fa93586-5920-4e3a-9911-268b4a0cc106 req-aa3a7045-64b6-4dfd-baaa-d9f989f82d38 service nova] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8fa93586-5920-4e3a-9911-268b4a0cc106 req-aa3a7045-64b6-4dfd-baaa-d9f989f82d38 service nova] Lock "84819dea-4fd7-44cd-83a1-10e62263edca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-8fa93586-5920-4e3a-9911-268b4a0cc106 req-aa3a7045-64b6-4dfd-baaa-d9f989f82d38 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] No waiting events found dispatching network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:15 user nova-compute[73208]: WARNING nova.compute.manager [req-8fa93586-5920-4e3a-9911-268b4a0cc106 req-aa3a7045-64b6-4dfd-baaa-d9f989f82d38 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received unexpected event network-vif-plugged-d6f60e94-e3b7-45e1-a723-fb9c7250902e for instance with vm_state active and task_state deleting.
Aug 16 09:09:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-8fa93586-5920-4e3a-9911-268b4a0cc106 req-aa3a7045-64b6-4dfd-baaa-d9f989f82d38 service nova] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Received event network-vif-deleted-d6f60e94-e3b7-45e1-a723-fb9c7250902e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BADTbFch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23134326136393737', 'path': '/dev/sdf'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134326136393737', 'path': '/dev/sdf'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.objects.instance [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lazy-loading 'flavor' on Instance uuid 77d077df-579d-4d9d-b76b-14d5d0a0d26f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 09:09:16 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:16 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:09:16 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:09:16 user nova-compute[73208]:   <serial>727678eb-0ad9-4072-863e-3b021744941f</serial>
Aug 16 09:09:16 user nova-compute[73208]: </disk>
Aug 16 09:09:16 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-6449a207-800d-4606-84d9-741783724db0 req-c13f5f9c-9d60-4a97-a8ef-770a00c51bc6 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received event network-changed-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-6449a207-800d-4606-84d9-741783724db0 req-c13f5f9c-9d60-4a97-a8ef-770a00c51bc6 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Refreshing instance network info cache due to event network-changed-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6449a207-800d-4606-84d9-741783724db0 req-c13f5f9c-9d60-4a97-a8ef-770a00c51bc6 service nova] Acquiring lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6449a207-800d-4606-84d9-741783724db0 req-c13f5f9c-9d60-4a97-a8ef-770a00c51bc6 service nova] Acquired lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-6449a207-800d-4606-84d9-741783724db0 req-c13f5f9c-9d60-4a97-a8ef-770a00c51bc6 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Refreshing network info cache for port 91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:16 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Deleted allocations for instance 84819dea-4fd7-44cd-83a1-10e62263edca
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-da08fbe9-fe50-4294-9f93-c428c80002b6 tempest-AttachSCSIVolumeTestJSON-1469266961 tempest-AttachSCSIVolumeTestJSON-1469266961-project-member] Lock "84819dea-4fd7-44cd-83a1-10e62263edca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.114s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] No VIF found with MAC fa:16:3e:8b:4b:16, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-6449a207-800d-4606-84d9-741783724db0 req-c13f5f9c-9d60-4a97-a8ef-770a00c51bc6 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updated VIF entry in instance network info cache for port 91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-6449a207-800d-4606-84d9-741783724db0 req-c13f5f9c-9d60-4a97-a8ef-770a00c51bc6 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updating instance_info_cache with network_info: [{"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2274de27-a02b-46ba-aea4-fdd1c89228e9 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.117s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6449a207-800d-4606-84d9-741783724db0 req-c13f5f9c-9d60-4a97-a8ef-770a00c51bc6 service nova] Releasing lock "refresh_cache-9b4f9560-9aae-4591-9037-c76c1504f170" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-13174d85-0c4d-44d6-be0a-297ea04c12d5 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] volume_snapshot_create: create_info: {'snapshot_id': '9595c775-c943-4518-9420-5608ff7605ee', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73208) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 09:09:17 user nova-compute[73208]: INFO nova.compute.manager [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Rebuilding instance
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-13174d85-0c4d-44d6-be0a-297ea04c12d5 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] snap xml: <domainsnapshot>
Aug 16 09:09:17 user nova-compute[73208]:   <disks>
Aug 16 09:09:17 user nova-compute[73208]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 16 09:09:17 user nova-compute[73208]:       <source file="/dev/new_file"/>
Aug 16 09:09:17 user nova-compute[73208]:     </disk>
Aug 16 09:09:17 user nova-compute[73208]:     <disk name="vda" snapshot="no"/>
Aug 16 09:09:17 user nova-compute[73208]:   </disks>
Aug 16 09:09:17 user nova-compute[73208]: </domainsnapshot>
Aug 16 09:09:17 user nova-compute[73208]:  {{(pid=73208) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.objects.instance [None req-13174d85-0c4d-44d6-be0a-297ea04c12d5 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lazy-loading 'system_metadata' on Instance uuid 77d077df-579d-4d9d-b76b-14d5d0a0d26f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-def32ab9-5178-432c-bf13-a0e11bc9c2c0 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] volume_snapshot_delete: delete_info: {'volume_id': '727678eb-0ad9-4072-863e-3b021744941f'} {{(pid=73208) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [None req-def32ab9-5178-432c-bf13-a0e11bc9c2c0 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     if delete_info['type'] != 'qcow2':
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] KeyError: 'type'
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] 
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:17 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-13174d85-0c4d-44d6-be0a-297ea04c12d5 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9b4f9560-9aae-4591-9037-c76c1504f170 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [None req-13174d85-0c4d-44d6-be0a-297ea04c12d5 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     rv = execute(f, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     six.reraise(c, e, tb)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     raise value
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     rv = meth(*args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [None req-13174d85-0c4d-44d6-be0a-297ea04c12d5 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     self._volume_snapshot_create(context, instance, guest,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     rv = execute(f, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     six.reraise(c, e, tb)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     raise value
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     rv = meth(*args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [None req-def32ab9-5178-432c-bf13-a0e11bc9c2c0 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e1020db4-e764-40a1-af96-337f1b3bfb6d)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server [None req-def32ab9-5178-432c-bf13-a0e11bc9c2c0 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver [None req-13174d85-0c4d-44d6-be0a-297ea04c12d5 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 9595c775-c943-4518-9420-5608ff7605ee could not be found.
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 9595c775-c943-4518-9420-5608ff7605ee could not be found. (HTTP 404) (Request-ID: req-5c868066-d0c6-4653-9388-8d71d09a4308)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 9595c775-c943-4518-9420-5608ff7605ee could not be found.
Aug 16 09:09:17 user nova-compute[73208]: ERROR nova.virt.libvirt.driver 
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server [None req-13174d85-0c4d-44d6-be0a-297ea04c12d5 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 09:09:17 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lazy-loading 'pci_requests' on Instance uuid 9b4f9560-9aae-4591-9037-c76c1504f170 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b4f9560-9aae-4591-9037-c76c1504f170 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lazy-loading 'resources' on Instance uuid 9b4f9560-9aae-4591-9037-c76c1504f170 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lazy-loading 'migration_context' on Instance uuid 9b4f9560-9aae-4591-9037-c76c1504f170 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73208) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:18 user nova-compute[73208]: INFO nova.compute.manager [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Detaching volume 727678eb-0ad9-4072-863e-3b021744941f
Aug 16 09:09:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:18 user nova-compute[73208]: INFO nova.virt.block_device [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Attempting to driver detach volume 727678eb-0ad9-4072-863e-3b021744941f from mountpoint /dev/vdb
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Attempting to detach device vdb from instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 09:09:18 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:18 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:09:18 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:09:18 user nova-compute[73208]:   <serial>727678eb-0ad9-4072-863e-3b021744941f</serial>
Aug 16 09:09:18 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:09:18 user nova-compute[73208]: </disk>
Aug 16 09:09:18 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-f9564d96-8685-4e58-b383-cec5b9036487 req-88b909f5-e855-40a5-9dbd-a414d6ee66a1 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received event network-vif-unplugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f9564d96-8685-4e58-b383-cec5b9036487 req-88b909f5-e855-40a5-9dbd-a414d6ee66a1 service nova] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f9564d96-8685-4e58-b383-cec5b9036487 req-88b909f5-e855-40a5-9dbd-a414d6ee66a1 service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f9564d96-8685-4e58-b383-cec5b9036487 req-88b909f5-e855-40a5-9dbd-a414d6ee66a1 service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-f9564d96-8685-4e58-b383-cec5b9036487 req-88b909f5-e855-40a5-9dbd-a414d6ee66a1 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] No waiting events found dispatching network-vif-unplugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:18 user nova-compute[73208]: WARNING nova.compute.manager [req-f9564d96-8685-4e58-b383-cec5b9036487 req-88b909f5-e855-40a5-9dbd-a414d6ee66a1 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received unexpected event network-vif-unplugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 for instance with vm_state active and task_state rebuilding.
Aug 16 09:09:18 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Successfully detached device vdb from instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f from the persistent domain config.
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 09:09:18 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:18 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:09:18 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:09:18 user nova-compute[73208]:   <serial>727678eb-0ad9-4072-863e-3b021744941f</serial>
Aug 16 09:09:18 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:09:18 user nova-compute[73208]: </disk>
Aug 16 09:09:18 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692176958.9002867, 77d077df-579d-4d9d-b76b-14d5d0a0d26f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:09:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Successfully detached device vdb from instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f from the live domain config.
Aug 16 09:09:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance destroyed successfully.
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BADTbFch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:19 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:09:19 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7494MB free_disk=25.77562713623047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[440fa648-4d2a-49c6-b90a-ac752ab04ece]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance destroyed successfully.
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-189156513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2135176385',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqVMHp97P9ublYenAcgiSOc9ytp+GzRvrXFO7o7iJo+WF+qpCY0zMqmhKHd0j/TNreM8QuEhFCVAjULrP8OMq5bCydKoV0CuzEeL7alWBhWv+5yB6zpO1Fk0vqcEP3NTA==',key_name='tempest-keypair-216633937',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4e2b7d360dd490e92b4059046b5dbac',ramdisk_id='',reservation_id='r-2rx0673y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-945797344',owner_user_name='tempest-ServerActionsV293TestJSON-945797344-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb4f290b3a9d41f0830720605ea7e601',uuid=9b4f9560-9aae-4591-9037-c76c1504f170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Converting VIF {"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_vif [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f4f751-4d, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[40272108-a741-4a7f-ad86-e32f6aa7e21f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f (non-flash)
Aug 16 09:09:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f (non-flash)
Aug 16 09:09:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d06612d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f'): ({'sdf'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Removing single pathed devices sdf {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: INFO os_vif [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d')
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoJpVtzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:19 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[13925130-3680-4aa5-8ebf-8d0a02e654f6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c322a4e3-6550-4532-b2ec-8e2b8f87eb54]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Flushing IO for device /dev/sdf {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbedb25-63e9-403a-bee5-acacd325787e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 341d90a7-086a-42ce-9c23-d3422883d13e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9b4f9560-9aae-4591-9037-c76c1504f170 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9333a6d0-50a9-456a-8948-6f0f20ed8b45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0fb21b62-0a07-426e-983e-86a33994b653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[585be1de-7c0f-48b2-93cf-d52e47b03c26]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e846ba7-b428-422d-adbc-bf78a00f4f8c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1503978-9e47-4312-b08b-afec1e43b38a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f, portal: 172.16.0.220,3260]
Aug 16 09:09:19 user nova-compute[73208]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:727678eb-0ad9-4072-863e-3b021744941f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e439bab-3c8a-446c-9cf6-84ad02d19cfa]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] <== disconnect_volume: return (305ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.239s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5995a2-be0f-4ea2-adc9-46f98b368efd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10e9f46-2c77-4519-8276-eee7609f2a82]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0662440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be4ab06-f4d5-4d58-b264-5b81bfed2349]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b459876-a039-4c04-991a-3dada32a7b6b]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[579a1320-0bf4-40c6-b1c4-56fa40f0d87c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[16401895-f1f0-4df2-b9f9-5a19a009f9b1]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4af368-301d-48f1-b09b-8b1286a5bfee]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b984a92-3074-455d-8e93-41b87c3530d1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d, portal: 172.16.0.220,3260]
Aug 16 09:09:19 user nova-compute[73208]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a18e5a0-ff10-4b8e-9333-b62646e29263]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] <== disconnect_volume: return (561ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:09:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Deleting instance files /opt/stack/data/nova/instances/9b4f9560-9aae-4591-9037-c76c1504f170_del
Aug 16 09:09:20 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Deletion of /opt/stack/data/nova/instances/9b4f9560-9aae-4591-9037-c76c1504f170_del complete
Aug 16 09:09:20 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9b4f9560-9aae-4591-9037-c76c1504f170 could not be found.
Aug 16 09:09:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoJpVtzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:20 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1e317e-c4e0-49c3-8e34-93e9b1a531df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-c814f2a9-316e-4440-8237-438558e6cf75 req-33d9eb8e-7cd5-4e0f-b8a4-a3dba710bb42 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received event network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c814f2a9-316e-4440-8237-438558e6cf75 req-33d9eb8e-7cd5-4e0f-b8a4-a3dba710bb42 service nova] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c814f2a9-316e-4440-8237-438558e6cf75 req-33d9eb8e-7cd5-4e0f-b8a4-a3dba710bb42 service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c814f2a9-316e-4440-8237-438558e6cf75 req-33d9eb8e-7cd5-4e0f-b8a4-a3dba710bb42 service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-c814f2a9-316e-4440-8237-438558e6cf75 req-33d9eb8e-7cd5-4e0f-b8a4-a3dba710bb42 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] No waiting events found dispatching network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:20 user nova-compute[73208]: WARNING nova.compute.manager [req-c814f2a9-316e-4440-8237-438558e6cf75 req-33d9eb8e-7cd5-4e0f-b8a4-a3dba710bb42 service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received unexpected event network-vif-plugged-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 for instance with vm_state active and task_state rebuilding.
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cb0339-ec6b-4778-99e9-d5412ef3b5c3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:20 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:20 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:20 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:20 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:20 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:20 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:20 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:20 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d074da20>, {}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Disconnecting from: [] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] <== disconnect_volume: return (64ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG nova.objects.instance [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lazy-loading 'flavor' on Instance uuid 77d077df-579d-4d9d-b76b-14d5d0a0d26f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e05d64c0-bfdb-44bf-a1e3-687b8a4cab81 tempest-VolumesAssistedSnapshotsTest-1193463350 tempest-VolumesAssistedSnapshotsTest-1193463350-project-admin] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.768s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:09:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:09:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:09:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:09:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCirVAyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:23 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:23 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:23 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692176948.752, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:09:23 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Stopped (Lifecycle Event)
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd18391-e063-48af-8d41-d0407e980d98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:09:23 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac5365a0-9820-4689-ba0e-e13e75c9347b None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac2d90-f26a-4c27-bc00-33512f149394]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94] added
Aug 16 09:09:23 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac5365a0-9820-4689-ba0e-e13e75c9347b None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[179be765-4088-41de-8820-a3deefad7ba2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b4dd80-477e-4be7-9070-4f096c5531f0]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCirVAyO {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCirVAyO" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7460e2d1-1656-4fca-aae0-9269a0c3c653]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCirVAyO'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29f38f-0cd7-4af8-9381-57afb8197874]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8727ae30-ec64-414b-84e3-1cd460533357]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:23 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:23 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:23 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:23 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:23 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:23 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:23 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:23 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7055ce-761d-4e06-bd75-d2d0f88eb783]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94, portal: 172.16.0.220,3260]
Aug 16 09:09:23 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:23 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfab1533-9542-494e-946f-694847ed6ad3]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba22db5-6d5c-4e95-8e6e-920cec8040d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 (non-flash)
Aug 16 09:09:24 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:24 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:24 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:24 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:24 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 (non-flash)
Aug 16 09:09:24 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:24 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:24 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:24 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:24 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Preparing to wait for external event volume-reimaged-d37615d3-44d4-4152-8d90-d480a38c255d {{(pid=73208) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a178c5a-2618-46da-8232-f66da3b4b49f]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCirVAyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23637376539336139', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637376539336139', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG nova.objects.instance [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'flavor' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:09:25 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:25 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:09:25 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:09:25 user nova-compute[73208]:   <serial>12d07bae-3892-4786-ac4e-c0d10a492e94</serial>
Aug 16 09:09:25 user nova-compute[73208]: </disk>
Aug 16 09:09:25 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No BDM found with device name hda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] No VIF found with MAC fa:16:3e:c2:f8:7f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:09:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e4d-0ecf-46ea-b157-3383ef4d195f tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.394s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:26 user nova-compute[73208]: INFO nova.compute.manager [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Detaching volume 12d07bae-3892-4786-ac4e-c0d10a492e94
Aug 16 09:09:26 user nova-compute[73208]: INFO nova.virt.block_device [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Attempting to driver detach volume 12d07bae-3892-4786-ac4e-c0d10a492e94 from mountpoint /dev/vdb
Aug 16 09:09:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Attempting to detach device vdb from instance 341d90a7-086a-42ce-9c23-d3422883d13e from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:09:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:09:26 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:26 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:09:26 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:09:26 user nova-compute[73208]:   <serial>12d07bae-3892-4786-ac4e-c0d10a492e94</serial>
Aug 16 09:09:26 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 09:09:26 user nova-compute[73208]: </disk>
Aug 16 09:09:26 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:09:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Successfully detached device vdb from instance 341d90a7-086a-42ce-9c23-d3422883d13e from the persistent domain config.
Aug 16 09:09:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 341d90a7-086a-42ce-9c23-d3422883d13e from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:09:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:09:26 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:09:26 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:09:26 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:09:26 user nova-compute[73208]:   <serial>12d07bae-3892-4786-ac4e-c0d10a492e94</serial>
Aug 16 09:09:26 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 09:09:26 user nova-compute[73208]: </disk>
Aug 16 09:09:26 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692176967.4158676, 341d90a7-086a-42ce-9c23-d3422883d13e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:09:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Successfully detached device vdb from instance 341d90a7-086a-42ce-9c23-d3422883d13e from the live domain config.
Aug 16 09:09:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCirVAyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:27 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6016a026-131c-47c0-8616-22610ac0b4ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de13c37-69a6-4bf8-8c36-c270377a7243]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 (non-flash)
Aug 16 09:09:27 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:27 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:27 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:27 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 (non-flash)
Aug 16 09:09:27 user nova-compute[73208]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:27 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:27 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:27 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ff6aac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf17fd7-a7a2-4ed9-8b02-380aa3e13771]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[20827f4b-c792-48fd-b408-77e86d183ede]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588473f-ad62-4106-9baf-e34a599377a9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf3c57d-9e95-4061-91ef-9f7e267d94cf]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dac008-9435-4492-b24e-8d93e564fd2c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[62300fd1-ea72-4c06-b982-2d79a0af0234]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94, portal: 172.16.0.220,3260]
Aug 16 09:09:27 user nova-compute[73208]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d07bae-3892-4786-ac4e-c0d10a492e94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cdc368-6cc0-40fb-867e-0404d03159de]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] <== disconnect_volume: return (304ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:09:29 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692176954.3012044, 84819dea-4fd7-44cd-83a1-10e62263edca => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:09:29 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] VM Stopped (Lifecycle Event)
Aug 16 09:09:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f6e121cb-d931-486e-8225-370047c74297 None None] [instance: 84819dea-4fd7-44cd-83a1-10e62263edca] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:09:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:33 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692176958.9062161, 9b4f9560-9aae-4591-9037-c76c1504f170 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:09:33 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] VM Stopped (Lifecycle Event)
Aug 16 09:09:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c9f003c3-db2b-4853-bae3-476c9cc3dc6d None None] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:09:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'flavor' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-16168c85-826b-420b-baa9-b7b77959f388 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.439s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "interface-341d90a7-086a-42ce-9c23-d3422883d13e-2a212149-e8a4-4161-8258-81abbe2861e5" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "interface-341d90a7-086a-42ce-9c23-d3422883d13e-2a212149-e8a4-4161-8258-81abbe2861e5" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'flavor' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converting VIF {"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface> {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface> {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Attempting to detach device tap2a212149-e8 from instance 341d90a7-086a-42ce-9c23-d3422883d13e from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] detach device xml: <interface type="ethernet">
Aug 16 09:09:36 user nova-compute[73208]:   <mac address="fa:16:3e:00:73:1a"/>
Aug 16 09:09:36 user nova-compute[73208]:   <model type="virtio"/>
Aug 16 09:09:36 user nova-compute[73208]:   <mtu size="1442"/>
Aug 16 09:09:36 user nova-compute[73208]:   <target dev="tap2a212149-e8"/>
Aug 16 09:09:36 user nova-compute[73208]: </interface>
Aug 16 09:09:36 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface> {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 09:09:36 user nova-compute[73208]:   <name>instance-00000007</name>
Aug 16 09:09:36 user nova-compute[73208]:   <uuid>341d90a7-086a-42ce-9c23-d3422883d13e</uuid>
Aug 16 09:09:36 user nova-compute[73208]:   <metadata>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:09:36 user nova-compute[73208]:   <nova:package version="0.0.0"/>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:name>tempest-device-tagging-server-618417393</nova:name>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:creationTime>2023-08-16 09:08:55</nova:creationTime>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:flavor name="m1.tiny">
Aug 16 09:09:36 user nova-compute[73208]:     <nova:memory>512</nova:memory>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:disk>1</nova:disk>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:swap>0</nova:swap>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:vcpus>1</nova:vcpus>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:flavor>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:owner>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:user uuid="47c19f8b4a714169ba98d35d751dafd7">tempest-TaggedAttachmentsTest-2091015158-project-member</nova:user>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:project uuid="293a0d6bce9943868579b6b88a526f2b">tempest-TaggedAttachmentsTest-2091015158</nova:project>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:owner>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:ports>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:port uuid="19a387ca-2e14-4170-947a-5f2b5f1f9bf1">
Aug 16 09:09:36 user nova-compute[73208]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:09:36 user nova-compute[73208]:     </nova:port>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:port uuid="2a212149-e8a4-4161-8258-81abbe2861e5">
Aug 16 09:09:36 user nova-compute[73208]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Aug 16 09:09:36 user nova-compute[73208]:     </nova:port>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:ports>
Aug 16 09:09:36 user nova-compute[73208]: </nova:instance>
Aug 16 09:09:36 user nova-compute[73208]:   </metadata>
Aug 16 09:09:36 user nova-compute[73208]:   <memory unit='KiB'>524288</memory>
Aug 16 09:09:36 user nova-compute[73208]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 09:09:36 user nova-compute[73208]:   <vcpu placement='static'>1</vcpu>
Aug 16 09:09:36 user nova-compute[73208]:   <resource>
Aug 16 09:09:36 user nova-compute[73208]:     <partition>/machine</partition>
Aug 16 09:09:36 user nova-compute[73208]:   </resource>
Aug 16 09:09:36 user nova-compute[73208]:   <sysinfo type='smbios'>
Aug 16 09:09:36 user nova-compute[73208]:     <system>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='version'>0.0.0</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='serial'>341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='uuid'>341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='family'>Virtual Machine</entry>
Aug 16 09:09:36 user nova-compute[73208]:     </system>
Aug 16 09:09:36 user nova-compute[73208]:   </sysinfo>
Aug 16 09:09:36 user nova-compute[73208]:   <os>
Aug 16 09:09:36 user nova-compute[73208]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 09:09:36 user nova-compute[73208]:     <boot dev='hd'/>
Aug 16 09:09:36 user nova-compute[73208]:     <smbios mode='sysinfo'/>
Aug 16 09:09:36 user nova-compute[73208]:   </os>
Aug 16 09:09:36 user nova-compute[73208]:   <features>
Aug 16 09:09:36 user nova-compute[73208]:     <acpi/>
Aug 16 09:09:36 user nova-compute[73208]:     <apic/>
Aug 16 09:09:36 user nova-compute[73208]:     <vmcoreinfo state='on'/>
Aug 16 09:09:36 user nova-compute[73208]:   </features>
Aug 16 09:09:36 user nova-compute[73208]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 09:09:36 user nova-compute[73208]:     <model fallback='forbid'>Nehalem</model>
Aug 16 09:09:36 user nova-compute[73208]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 09:09:36 user nova-compute[73208]:     <feature policy='require' name='vme'/>
Aug 16 09:09:36 user nova-compute[73208]:     <feature policy='require' name='x2apic'/>
Aug 16 09:09:36 user nova-compute[73208]:     <feature policy='require' name='hypervisor'/>
Aug 16 09:09:36 user nova-compute[73208]:   </cpu>
Aug 16 09:09:36 user nova-compute[73208]:   <clock offset='utc'>
Aug 16 09:09:36 user nova-compute[73208]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 09:09:36 user nova-compute[73208]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 09:09:36 user nova-compute[73208]:     <timer name='hpet' present='no'/>
Aug 16 09:09:36 user nova-compute[73208]:   </clock>
Aug 16 09:09:36 user nova-compute[73208]:   <on_poweroff>destroy</on_poweroff>
Aug 16 09:09:36 user nova-compute[73208]:   <on_reboot>restart</on_reboot>
Aug 16 09:09:36 user nova-compute[73208]:   <on_crash>destroy</on_crash>
Aug 16 09:09:36 user nova-compute[73208]:   <devices>
Aug 16 09:09:36 user nova-compute[73208]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 09:09:36 user nova-compute[73208]:     <disk type='file' device='disk'>
Aug 16 09:09:36 user nova-compute[73208]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 09:09:36 user nova-compute[73208]:       <source file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk' index='2'/>
Aug 16 09:09:36 user nova-compute[73208]:       <backingStore type='file' index='3'>
Aug 16 09:09:36 user nova-compute[73208]:         <format type='raw'/>
Aug 16 09:09:36 user nova-compute[73208]:         <source file='/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484'/>
Aug 16 09:09:36 user nova-compute[73208]:         <backingStore/>
Aug 16 09:09:36 user nova-compute[73208]:       </backingStore>
Aug 16 09:09:36 user nova-compute[73208]:       <target dev='vda' bus='virtio'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='virtio-disk0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </disk>
Aug 16 09:09:36 user nova-compute[73208]:     <disk type='file' device='cdrom'>
Aug 16 09:09:36 user nova-compute[73208]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 09:09:36 user nova-compute[73208]:       <source file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.config' index='1'/>
Aug 16 09:09:36 user nova-compute[73208]:       <backingStore/>
Aug 16 09:09:36 user nova-compute[73208]:       <target dev='hda' bus='ide'/>
Aug 16 09:09:36 user nova-compute[73208]:       <readonly/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='ide0-0-0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </disk>
Aug 16 09:09:36 user nova-compute[73208]:     <controller type='usb' index='0' model='none'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='usb'/>
Aug 16 09:09:36 user nova-compute[73208]:     </controller>
Aug 16 09:09:36 user nova-compute[73208]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='pci.0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </controller>
Aug 16 09:09:36 user nova-compute[73208]:     <controller type='ide' index='0'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='ide'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 09:09:36 user nova-compute[73208]:     </controller>
Aug 16 09:09:36 user nova-compute[73208]:     <interface type='ethernet'>
Aug 16 09:09:36 user nova-compute[73208]:       <mac address='fa:16:3e:c2:f8:7f'/>
Aug 16 09:09:36 user nova-compute[73208]:       <target dev='tap19a387ca-2e'/>
Aug 16 09:09:36 user nova-compute[73208]:       <model type='virtio'/>
Aug 16 09:09:36 user nova-compute[73208]:       <mtu size='1442'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='net0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </interface>
Aug 16 09:09:36 user nova-compute[73208]:     <interface type='ethernet'>
Aug 16 09:09:36 user nova-compute[73208]:       <mac address='fa:16:3e:00:73:1a'/>
Aug 16 09:09:36 user nova-compute[73208]:       <target dev='tap2a212149-e8'/>
Aug 16 09:09:36 user nova-compute[73208]:       <model type='virtio'/>
Aug 16 09:09:36 user nova-compute[73208]:       <mtu size='1442'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='net1'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </interface>
Aug 16 09:09:36 user nova-compute[73208]:     <serial type='pty'>
Aug 16 09:09:36 user nova-compute[73208]:       <source path='/dev/pts/6'/>
Aug 16 09:09:36 user nova-compute[73208]:       <log file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log' append='off'/>
Aug 16 09:09:36 user nova-compute[73208]:       <target type='isa-serial' port='0'>
Aug 16 09:09:36 user nova-compute[73208]:         <model name='isa-serial'/>
Aug 16 09:09:36 user nova-compute[73208]:       </target>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='serial0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </serial>
Aug 16 09:09:36 user nova-compute[73208]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 09:09:36 user nova-compute[73208]:       <source path='/dev/pts/6'/>
Aug 16 09:09:36 user nova-compute[73208]:       <log file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log' append='off'/>
Aug 16 09:09:36 user nova-compute[73208]:       <target type='serial' port='0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='serial0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </console>
Aug 16 09:09:36 user nova-compute[73208]:     <input type='mouse' bus='ps2'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='input0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </input>
Aug 16 09:09:36 user nova-compute[73208]:     <input type='keyboard' bus='ps2'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='input1'/>
Aug 16 09:09:36 user nova-compute[73208]:     </input>
Aug 16 09:09:36 user nova-compute[73208]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 09:09:36 user nova-compute[73208]:       <listen type='address' address='0.0.0.0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </graphics>
Aug 16 09:09:36 user nova-compute[73208]:     <audio id='1' type='none'/>
Aug 16 09:09:36 user nova-compute[73208]:     <video>
Aug 16 09:09:36 user nova-compute[73208]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='video0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </video>
Aug 16 09:09:36 user nova-compute[73208]:     <memballoon model='virtio'>
Aug 16 09:09:36 user nova-compute[73208]:       <stats period='10'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='balloon0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </memballoon>
Aug 16 09:09:36 user nova-compute[73208]:     <rng model='virtio'>
Aug 16 09:09:36 user nova-compute[73208]:       <backend model='random'>/dev/urandom</backend>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='rng0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </rng>
Aug 16 09:09:36 user nova-compute[73208]:   </devices>
Aug 16 09:09:36 user nova-compute[73208]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 09:09:36 user nova-compute[73208]:     <label>libvirt-341d90a7-086a-42ce-9c23-d3422883d13e</label>
Aug 16 09:09:36 user nova-compute[73208]:     <imagelabel>libvirt-341d90a7-086a-42ce-9c23-d3422883d13e</imagelabel>
Aug 16 09:09:36 user nova-compute[73208]:   </seclabel>
Aug 16 09:09:36 user nova-compute[73208]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 09:09:36 user nova-compute[73208]:     <label>+64055:+108</label>
Aug 16 09:09:36 user nova-compute[73208]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 09:09:36 user nova-compute[73208]:   </seclabel>
Aug 16 09:09:36 user nova-compute[73208]: </domain>
Aug 16 09:09:36 user nova-compute[73208]:  {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 09:09:36 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Successfully detached device tap2a212149-e8 from instance 341d90a7-086a-42ce-9c23-d3422883d13e from the persistent domain config.
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] (1/8): Attempting to detach device tap2a212149-e8 with device alias net1 from instance 341d90a7-086a-42ce-9c23-d3422883d13e from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] detach device xml: <interface type="ethernet">
Aug 16 09:09:36 user nova-compute[73208]:   <mac address="fa:16:3e:00:73:1a"/>
Aug 16 09:09:36 user nova-compute[73208]:   <model type="virtio"/>
Aug 16 09:09:36 user nova-compute[73208]:   <mtu size="1442"/>
Aug 16 09:09:36 user nova-compute[73208]:   <target dev="tap2a212149-e8"/>
Aug 16 09:09:36 user nova-compute[73208]: </interface>
Aug 16 09:09:36 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692176976.9556022, 341d90a7-086a-42ce-9c23-d3422883d13e => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Start waiting for the detach event from libvirt for device tap2a212149-e8 with device alias net1 for instance 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface> {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 09:09:36 user nova-compute[73208]:   <name>instance-00000007</name>
Aug 16 09:09:36 user nova-compute[73208]:   <uuid>341d90a7-086a-42ce-9c23-d3422883d13e</uuid>
Aug 16 09:09:36 user nova-compute[73208]:   <metadata>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:09:36 user nova-compute[73208]:   <nova:package version="0.0.0"/>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:name>tempest-device-tagging-server-618417393</nova:name>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:creationTime>2023-08-16 09:08:55</nova:creationTime>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:flavor name="m1.tiny">
Aug 16 09:09:36 user nova-compute[73208]:     <nova:memory>512</nova:memory>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:disk>1</nova:disk>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:swap>0</nova:swap>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:vcpus>1</nova:vcpus>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:flavor>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:owner>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:user uuid="47c19f8b4a714169ba98d35d751dafd7">tempest-TaggedAttachmentsTest-2091015158-project-member</nova:user>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:project uuid="293a0d6bce9943868579b6b88a526f2b">tempest-TaggedAttachmentsTest-2091015158</nova:project>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:owner>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:ports>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:port uuid="19a387ca-2e14-4170-947a-5f2b5f1f9bf1">
Aug 16 09:09:36 user nova-compute[73208]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:09:36 user nova-compute[73208]:     </nova:port>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:port uuid="2a212149-e8a4-4161-8258-81abbe2861e5">
Aug 16 09:09:36 user nova-compute[73208]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Aug 16 09:09:36 user nova-compute[73208]:     </nova:port>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:ports>
Aug 16 09:09:36 user nova-compute[73208]: </nova:instance>
Aug 16 09:09:36 user nova-compute[73208]:   </metadata>
Aug 16 09:09:36 user nova-compute[73208]:   <memory unit='KiB'>524288</memory>
Aug 16 09:09:36 user nova-compute[73208]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 09:09:36 user nova-compute[73208]:   <vcpu placement='static'>1</vcpu>
Aug 16 09:09:36 user nova-compute[73208]:   <resource>
Aug 16 09:09:36 user nova-compute[73208]:     <partition>/machine</partition>
Aug 16 09:09:36 user nova-compute[73208]:   </resource>
Aug 16 09:09:36 user nova-compute[73208]:   <sysinfo type='smbios'>
Aug 16 09:09:36 user nova-compute[73208]:     <system>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='version'>0.0.0</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='serial'>341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='uuid'>341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:09:36 user nova-compute[73208]:       <entry name='family'>Virtual Machine</entry>
Aug 16 09:09:36 user nova-compute[73208]:     </system>
Aug 16 09:09:36 user nova-compute[73208]:   </sysinfo>
Aug 16 09:09:36 user nova-compute[73208]:   <os>
Aug 16 09:09:36 user nova-compute[73208]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 09:09:36 user nova-compute[73208]:     <boot dev='hd'/>
Aug 16 09:09:36 user nova-compute[73208]:     <smbios mode='sysinfo'/>
Aug 16 09:09:36 user nova-compute[73208]:   </os>
Aug 16 09:09:36 user nova-compute[73208]:   <features>
Aug 16 09:09:36 user nova-compute[73208]:     <acpi/>
Aug 16 09:09:36 user nova-compute[73208]:     <apic/>
Aug 16 09:09:36 user nova-compute[73208]:     <vmcoreinfo state='on'/>
Aug 16 09:09:36 user nova-compute[73208]:   </features>
Aug 16 09:09:36 user nova-compute[73208]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 09:09:36 user nova-compute[73208]:     <model fallback='forbid'>Nehalem</model>
Aug 16 09:09:36 user nova-compute[73208]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 09:09:36 user nova-compute[73208]:     <feature policy='require' name='vme'/>
Aug 16 09:09:36 user nova-compute[73208]:     <feature policy='require' name='x2apic'/>
Aug 16 09:09:36 user nova-compute[73208]:     <feature policy='require' name='hypervisor'/>
Aug 16 09:09:36 user nova-compute[73208]:   </cpu>
Aug 16 09:09:36 user nova-compute[73208]:   <clock offset='utc'>
Aug 16 09:09:36 user nova-compute[73208]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 09:09:36 user nova-compute[73208]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 09:09:36 user nova-compute[73208]:     <timer name='hpet' present='no'/>
Aug 16 09:09:36 user nova-compute[73208]:   </clock>
Aug 16 09:09:36 user nova-compute[73208]:   <on_poweroff>destroy</on_poweroff>
Aug 16 09:09:36 user nova-compute[73208]:   <on_reboot>restart</on_reboot>
Aug 16 09:09:36 user nova-compute[73208]:   <on_crash>destroy</on_crash>
Aug 16 09:09:36 user nova-compute[73208]:   <devices>
Aug 16 09:09:36 user nova-compute[73208]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 09:09:36 user nova-compute[73208]:     <disk type='file' device='disk'>
Aug 16 09:09:36 user nova-compute[73208]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 09:09:36 user nova-compute[73208]:       <source file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk' index='2'/>
Aug 16 09:09:36 user nova-compute[73208]:       <backingStore type='file' index='3'>
Aug 16 09:09:36 user nova-compute[73208]:         <format type='raw'/>
Aug 16 09:09:36 user nova-compute[73208]:         <source file='/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484'/>
Aug 16 09:09:36 user nova-compute[73208]:         <backingStore/>
Aug 16 09:09:36 user nova-compute[73208]:       </backingStore>
Aug 16 09:09:36 user nova-compute[73208]:       <target dev='vda' bus='virtio'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='virtio-disk0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </disk>
Aug 16 09:09:36 user nova-compute[73208]:     <disk type='file' device='cdrom'>
Aug 16 09:09:36 user nova-compute[73208]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 09:09:36 user nova-compute[73208]:       <source file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.config' index='1'/>
Aug 16 09:09:36 user nova-compute[73208]:       <backingStore/>
Aug 16 09:09:36 user nova-compute[73208]:       <target dev='hda' bus='ide'/>
Aug 16 09:09:36 user nova-compute[73208]:       <readonly/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='ide0-0-0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </disk>
Aug 16 09:09:36 user nova-compute[73208]:     <controller type='usb' index='0' model='none'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='usb'/>
Aug 16 09:09:36 user nova-compute[73208]:     </controller>
Aug 16 09:09:36 user nova-compute[73208]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='pci.0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </controller>
Aug 16 09:09:36 user nova-compute[73208]:     <controller type='ide' index='0'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='ide'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 09:09:36 user nova-compute[73208]:     </controller>
Aug 16 09:09:36 user nova-compute[73208]:     <interface type='ethernet'>
Aug 16 09:09:36 user nova-compute[73208]:       <mac address='fa:16:3e:c2:f8:7f'/>
Aug 16 09:09:36 user nova-compute[73208]:       <target dev='tap19a387ca-2e'/>
Aug 16 09:09:36 user nova-compute[73208]:       <model type='virtio'/>
Aug 16 09:09:36 user nova-compute[73208]:       <mtu size='1442'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='net0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </interface>
Aug 16 09:09:36 user nova-compute[73208]:     <serial type='pty'>
Aug 16 09:09:36 user nova-compute[73208]:       <source path='/dev/pts/6'/>
Aug 16 09:09:36 user nova-compute[73208]:       <log file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log' append='off'/>
Aug 16 09:09:36 user nova-compute[73208]:       <target type='isa-serial' port='0'>
Aug 16 09:09:36 user nova-compute[73208]:         <model name='isa-serial'/>
Aug 16 09:09:36 user nova-compute[73208]:       </target>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='serial0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </serial>
Aug 16 09:09:36 user nova-compute[73208]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 09:09:36 user nova-compute[73208]:       <source path='/dev/pts/6'/>
Aug 16 09:09:36 user nova-compute[73208]:       <log file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log' append='off'/>
Aug 16 09:09:36 user nova-compute[73208]:       <target type='serial' port='0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='serial0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </console>
Aug 16 09:09:36 user nova-compute[73208]:     <input type='mouse' bus='ps2'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='input0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </input>
Aug 16 09:09:36 user nova-compute[73208]:     <input type='keyboard' bus='ps2'>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='input1'/>
Aug 16 09:09:36 user nova-compute[73208]:     </input>
Aug 16 09:09:36 user nova-compute[73208]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 09:09:36 user nova-compute[73208]:       <listen type='address' address='0.0.0.0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </graphics>
Aug 16 09:09:36 user nova-compute[73208]:     <audio id='1' type='none'/>
Aug 16 09:09:36 user nova-compute[73208]:     <video>
Aug 16 09:09:36 user nova-compute[73208]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='video0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </video>
Aug 16 09:09:36 user nova-compute[73208]:     <memballoon model='virtio'>
Aug 16 09:09:36 user nova-compute[73208]:       <stats period='10'/>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='balloon0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </memballoon>
Aug 16 09:09:36 user nova-compute[73208]:     <rng model='virtio'>
Aug 16 09:09:36 user nova-compute[73208]:       <backend model='random'>/dev/urandom</backend>
Aug 16 09:09:36 user nova-compute[73208]:       <alias name='rng0'/>
Aug 16 09:09:36 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 09:09:36 user nova-compute[73208]:     </rng>
Aug 16 09:09:36 user nova-compute[73208]:   </devices>
Aug 16 09:09:36 user nova-compute[73208]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 09:09:36 user nova-compute[73208]:     <label>libvirt-341d90a7-086a-42ce-9c23-d3422883d13e</label>
Aug 16 09:09:36 user nova-compute[73208]:     <imagelabel>libvirt-341d90a7-086a-42ce-9c23-d3422883d13e</imagelabel>
Aug 16 09:09:36 user nova-compute[73208]:   </seclabel>
Aug 16 09:09:36 user nova-compute[73208]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 09:09:36 user nova-compute[73208]:     <label>+64055:+108</label>
Aug 16 09:09:36 user nova-compute[73208]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 09:09:36 user nova-compute[73208]:   </seclabel>
Aug 16 09:09:36 user nova-compute[73208]: </domain>
Aug 16 09:09:36 user nova-compute[73208]:  {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 09:09:36 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Successfully detached device tap2a212149-e8 from instance 341d90a7-086a-42ce-9c23-d3422883d13e from the live domain config.
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converting VIF {"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG os_vif [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a212149-e8, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:36 user nova-compute[73208]: INFO os_vif [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8')
Aug 16 09:09:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:09:36 user nova-compute[73208]:   <nova:package version="0.0.0"/>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:name>tempest-device-tagging-server-618417393</nova:name>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:creationTime>2023-08-16 09:09:36</nova:creationTime>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:flavor name="m1.tiny">
Aug 16 09:09:36 user nova-compute[73208]:     <nova:memory>512</nova:memory>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:disk>1</nova:disk>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:swap>0</nova:swap>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:vcpus>1</nova:vcpus>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:flavor>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:owner>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:user uuid="47c19f8b4a714169ba98d35d751dafd7">tempest-TaggedAttachmentsTest-2091015158-project-member</nova:user>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:project uuid="293a0d6bce9943868579b6b88a526f2b">tempest-TaggedAttachmentsTest-2091015158</nova:project>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:owner>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:09:36 user nova-compute[73208]:   <nova:ports>
Aug 16 09:09:36 user nova-compute[73208]:     <nova:port uuid="19a387ca-2e14-4170-947a-5f2b5f1f9bf1">
Aug 16 09:09:36 user nova-compute[73208]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:09:36 user nova-compute[73208]:     </nova:port>
Aug 16 09:09:36 user nova-compute[73208]:   </nova:ports>
Aug 16 09:09:36 user nova-compute[73208]: </nova:instance>
Aug 16 09:09:36 user nova-compute[73208]:  {{(pid=73208) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-67fb02c1-0aa8-4856-9a23-8b76c5ff7995 req-9cd95208-c842-4d47-9d1d-8664d0145516 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-unplugged-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-67fb02c1-0aa8-4856-9a23-8b76c5ff7995 req-9cd95208-c842-4d47-9d1d-8664d0145516 service nova] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-67fb02c1-0aa8-4856-9a23-8b76c5ff7995 req-9cd95208-c842-4d47-9d1d-8664d0145516 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-67fb02c1-0aa8-4856-9a23-8b76c5ff7995 req-9cd95208-c842-4d47-9d1d-8664d0145516 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-67fb02c1-0aa8-4856-9a23-8b76c5ff7995 req-9cd95208-c842-4d47-9d1d-8664d0145516 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] No waiting events found dispatching network-vif-unplugged-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:37 user nova-compute[73208]: WARNING nova.compute.manager [req-67fb02c1-0aa8-4856-9a23-8b76c5ff7995 req-9cd95208-c842-4d47-9d1d-8664d0145516 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received unexpected event network-vif-unplugged-2a212149-e8a4-4161-8258-81abbe2861e5 for instance with vm_state active and task_state None.
Aug 16 09:09:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-deleted-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:37 user nova-compute[73208]: INFO nova.compute.manager [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Neutron deleted interface 2a212149-e8a4-4161-8258-81abbe2861e5; detaching it from the instance and deleting it from the info cache
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.network.neutron [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquired lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.objects.instance [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] Lazy-loading 'system_metadata' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.objects.instance [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] Lazy-loading 'flavor' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] Converting VIF {"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface> {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 09:09:37 user nova-compute[73208]:   <name>instance-00000007</name>
Aug 16 09:09:37 user nova-compute[73208]:   <uuid>341d90a7-086a-42ce-9c23-d3422883d13e</uuid>
Aug 16 09:09:37 user nova-compute[73208]:   <metadata>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:09:37 user nova-compute[73208]:   <nova:package version="0.0.0"/>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:name>tempest-device-tagging-server-618417393</nova:name>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:creationTime>2023-08-16 09:09:36</nova:creationTime>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:flavor name="m1.tiny">
Aug 16 09:09:37 user nova-compute[73208]:     <nova:memory>512</nova:memory>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:disk>1</nova:disk>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:swap>0</nova:swap>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:vcpus>1</nova:vcpus>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:flavor>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:owner>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:user uuid="47c19f8b4a714169ba98d35d751dafd7">tempest-TaggedAttachmentsTest-2091015158-project-member</nova:user>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:project uuid="293a0d6bce9943868579b6b88a526f2b">tempest-TaggedAttachmentsTest-2091015158</nova:project>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:owner>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:ports>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:port uuid="19a387ca-2e14-4170-947a-5f2b5f1f9bf1">
Aug 16 09:09:37 user nova-compute[73208]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:09:37 user nova-compute[73208]:     </nova:port>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:ports>
Aug 16 09:09:37 user nova-compute[73208]: </nova:instance>
Aug 16 09:09:37 user nova-compute[73208]:   </metadata>
Aug 16 09:09:37 user nova-compute[73208]:   <memory unit='KiB'>524288</memory>
Aug 16 09:09:37 user nova-compute[73208]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 09:09:37 user nova-compute[73208]:   <vcpu placement='static'>1</vcpu>
Aug 16 09:09:37 user nova-compute[73208]:   <resource>
Aug 16 09:09:37 user nova-compute[73208]:     <partition>/machine</partition>
Aug 16 09:09:37 user nova-compute[73208]:   </resource>
Aug 16 09:09:37 user nova-compute[73208]:   <sysinfo type='smbios'>
Aug 16 09:09:37 user nova-compute[73208]:     <system>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='version'>0.0.0</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='serial'>341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='uuid'>341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='family'>Virtual Machine</entry>
Aug 16 09:09:37 user nova-compute[73208]:     </system>
Aug 16 09:09:37 user nova-compute[73208]:   </sysinfo>
Aug 16 09:09:37 user nova-compute[73208]:   <os>
Aug 16 09:09:37 user nova-compute[73208]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 09:09:37 user nova-compute[73208]:     <boot dev='hd'/>
Aug 16 09:09:37 user nova-compute[73208]:     <smbios mode='sysinfo'/>
Aug 16 09:09:37 user nova-compute[73208]:   </os>
Aug 16 09:09:37 user nova-compute[73208]:   <features>
Aug 16 09:09:37 user nova-compute[73208]:     <acpi/>
Aug 16 09:09:37 user nova-compute[73208]:     <apic/>
Aug 16 09:09:37 user nova-compute[73208]:     <vmcoreinfo state='on'/>
Aug 16 09:09:37 user nova-compute[73208]:   </features>
Aug 16 09:09:37 user nova-compute[73208]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 09:09:37 user nova-compute[73208]:     <model fallback='forbid'>Nehalem</model>
Aug 16 09:09:37 user nova-compute[73208]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 09:09:37 user nova-compute[73208]:     <feature policy='require' name='vme'/>
Aug 16 09:09:37 user nova-compute[73208]:     <feature policy='require' name='x2apic'/>
Aug 16 09:09:37 user nova-compute[73208]:     <feature policy='require' name='hypervisor'/>
Aug 16 09:09:37 user nova-compute[73208]:   </cpu>
Aug 16 09:09:37 user nova-compute[73208]:   <clock offset='utc'>
Aug 16 09:09:37 user nova-compute[73208]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 09:09:37 user nova-compute[73208]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 09:09:37 user nova-compute[73208]:     <timer name='hpet' present='no'/>
Aug 16 09:09:37 user nova-compute[73208]:   </clock>
Aug 16 09:09:37 user nova-compute[73208]:   <on_poweroff>destroy</on_poweroff>
Aug 16 09:09:37 user nova-compute[73208]:   <on_reboot>restart</on_reboot>
Aug 16 09:09:37 user nova-compute[73208]:   <on_crash>destroy</on_crash>
Aug 16 09:09:37 user nova-compute[73208]:   <devices>
Aug 16 09:09:37 user nova-compute[73208]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 09:09:37 user nova-compute[73208]:     <disk type='file' device='disk'>
Aug 16 09:09:37 user nova-compute[73208]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 09:09:37 user nova-compute[73208]:       <source file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk' index='2'/>
Aug 16 09:09:37 user nova-compute[73208]:       <backingStore type='file' index='3'>
Aug 16 09:09:37 user nova-compute[73208]:         <format type='raw'/>
Aug 16 09:09:37 user nova-compute[73208]:         <source file='/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484'/>
Aug 16 09:09:37 user nova-compute[73208]:         <backingStore/>
Aug 16 09:09:37 user nova-compute[73208]:       </backingStore>
Aug 16 09:09:37 user nova-compute[73208]:       <target dev='vda' bus='virtio'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='virtio-disk0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </disk>
Aug 16 09:09:37 user nova-compute[73208]:     <disk type='file' device='cdrom'>
Aug 16 09:09:37 user nova-compute[73208]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 09:09:37 user nova-compute[73208]:       <source file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.config' index='1'/>
Aug 16 09:09:37 user nova-compute[73208]:       <backingStore/>
Aug 16 09:09:37 user nova-compute[73208]:       <target dev='hda' bus='ide'/>
Aug 16 09:09:37 user nova-compute[73208]:       <readonly/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='ide0-0-0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </disk>
Aug 16 09:09:37 user nova-compute[73208]:     <controller type='usb' index='0' model='none'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='usb'/>
Aug 16 09:09:37 user nova-compute[73208]:     </controller>
Aug 16 09:09:37 user nova-compute[73208]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='pci.0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </controller>
Aug 16 09:09:37 user nova-compute[73208]:     <controller type='ide' index='0'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='ide'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 09:09:37 user nova-compute[73208]:     </controller>
Aug 16 09:09:37 user nova-compute[73208]:     <interface type='ethernet'>
Aug 16 09:09:37 user nova-compute[73208]:       <mac address='fa:16:3e:c2:f8:7f'/>
Aug 16 09:09:37 user nova-compute[73208]:       <target dev='tap19a387ca-2e'/>
Aug 16 09:09:37 user nova-compute[73208]:       <model type='virtio'/>
Aug 16 09:09:37 user nova-compute[73208]:       <mtu size='1442'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='net0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </interface>
Aug 16 09:09:37 user nova-compute[73208]:     <serial type='pty'>
Aug 16 09:09:37 user nova-compute[73208]:       <source path='/dev/pts/6'/>
Aug 16 09:09:37 user nova-compute[73208]:       <log file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log' append='off'/>
Aug 16 09:09:37 user nova-compute[73208]:       <target type='isa-serial' port='0'>
Aug 16 09:09:37 user nova-compute[73208]:         <model name='isa-serial'/>
Aug 16 09:09:37 user nova-compute[73208]:       </target>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='serial0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </serial>
Aug 16 09:09:37 user nova-compute[73208]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 09:09:37 user nova-compute[73208]:       <source path='/dev/pts/6'/>
Aug 16 09:09:37 user nova-compute[73208]:       <log file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log' append='off'/>
Aug 16 09:09:37 user nova-compute[73208]:       <target type='serial' port='0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='serial0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </console>
Aug 16 09:09:37 user nova-compute[73208]:     <input type='mouse' bus='ps2'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='input0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </input>
Aug 16 09:09:37 user nova-compute[73208]:     <input type='keyboard' bus='ps2'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='input1'/>
Aug 16 09:09:37 user nova-compute[73208]:     </input>
Aug 16 09:09:37 user nova-compute[73208]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 09:09:37 user nova-compute[73208]:       <listen type='address' address='0.0.0.0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </graphics>
Aug 16 09:09:37 user nova-compute[73208]:     <audio id='1' type='none'/>
Aug 16 09:09:37 user nova-compute[73208]:     <video>
Aug 16 09:09:37 user nova-compute[73208]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='video0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </video>
Aug 16 09:09:37 user nova-compute[73208]:     <memballoon model='virtio'>
Aug 16 09:09:37 user nova-compute[73208]:       <stats period='10'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='balloon0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </memballoon>
Aug 16 09:09:37 user nova-compute[73208]:     <rng model='virtio'>
Aug 16 09:09:37 user nova-compute[73208]:       <backend model='random'>/dev/urandom</backend>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='rng0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </rng>
Aug 16 09:09:37 user nova-compute[73208]:   </devices>
Aug 16 09:09:37 user nova-compute[73208]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 09:09:37 user nova-compute[73208]:     <label>libvirt-341d90a7-086a-42ce-9c23-d3422883d13e</label>
Aug 16 09:09:37 user nova-compute[73208]:     <imagelabel>libvirt-341d90a7-086a-42ce-9c23-d3422883d13e</imagelabel>
Aug 16 09:09:37 user nova-compute[73208]:   </seclabel>
Aug 16 09:09:37 user nova-compute[73208]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 09:09:37 user nova-compute[73208]:     <label>+64055:+108</label>
Aug 16 09:09:37 user nova-compute[73208]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 09:09:37 user nova-compute[73208]:   </seclabel>
Aug 16 09:09:37 user nova-compute[73208]: </domain>
Aug 16 09:09:37 user nova-compute[73208]:  {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface> {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:00:73:1a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2a212149-e8"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 09:09:37 user nova-compute[73208]:   <name>instance-00000007</name>
Aug 16 09:09:37 user nova-compute[73208]:   <uuid>341d90a7-086a-42ce-9c23-d3422883d13e</uuid>
Aug 16 09:09:37 user nova-compute[73208]:   <metadata>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:09:37 user nova-compute[73208]:   <nova:package version="0.0.0"/>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:name>tempest-device-tagging-server-618417393</nova:name>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:creationTime>2023-08-16 09:09:36</nova:creationTime>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:flavor name="m1.tiny">
Aug 16 09:09:37 user nova-compute[73208]:     <nova:memory>512</nova:memory>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:disk>1</nova:disk>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:swap>0</nova:swap>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:vcpus>1</nova:vcpus>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:flavor>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:owner>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:user uuid="47c19f8b4a714169ba98d35d751dafd7">tempest-TaggedAttachmentsTest-2091015158-project-member</nova:user>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:project uuid="293a0d6bce9943868579b6b88a526f2b">tempest-TaggedAttachmentsTest-2091015158</nova:project>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:owner>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:ports>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:port uuid="19a387ca-2e14-4170-947a-5f2b5f1f9bf1">
Aug 16 09:09:37 user nova-compute[73208]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:09:37 user nova-compute[73208]:     </nova:port>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:ports>
Aug 16 09:09:37 user nova-compute[73208]: </nova:instance>
Aug 16 09:09:37 user nova-compute[73208]:   </metadata>
Aug 16 09:09:37 user nova-compute[73208]:   <memory unit='KiB'>524288</memory>
Aug 16 09:09:37 user nova-compute[73208]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 09:09:37 user nova-compute[73208]:   <vcpu placement='static'>1</vcpu>
Aug 16 09:09:37 user nova-compute[73208]:   <resource>
Aug 16 09:09:37 user nova-compute[73208]:     <partition>/machine</partition>
Aug 16 09:09:37 user nova-compute[73208]:   </resource>
Aug 16 09:09:37 user nova-compute[73208]:   <sysinfo type='smbios'>
Aug 16 09:09:37 user nova-compute[73208]:     <system>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='version'>0.0.0</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='serial'>341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='uuid'>341d90a7-086a-42ce-9c23-d3422883d13e</entry>
Aug 16 09:09:37 user nova-compute[73208]:       <entry name='family'>Virtual Machine</entry>
Aug 16 09:09:37 user nova-compute[73208]:     </system>
Aug 16 09:09:37 user nova-compute[73208]:   </sysinfo>
Aug 16 09:09:37 user nova-compute[73208]:   <os>
Aug 16 09:09:37 user nova-compute[73208]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 09:09:37 user nova-compute[73208]:     <boot dev='hd'/>
Aug 16 09:09:37 user nova-compute[73208]:     <smbios mode='sysinfo'/>
Aug 16 09:09:37 user nova-compute[73208]:   </os>
Aug 16 09:09:37 user nova-compute[73208]:   <features>
Aug 16 09:09:37 user nova-compute[73208]:     <acpi/>
Aug 16 09:09:37 user nova-compute[73208]:     <apic/>
Aug 16 09:09:37 user nova-compute[73208]:     <vmcoreinfo state='on'/>
Aug 16 09:09:37 user nova-compute[73208]:   </features>
Aug 16 09:09:37 user nova-compute[73208]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 09:09:37 user nova-compute[73208]:     <model fallback='forbid'>Nehalem</model>
Aug 16 09:09:37 user nova-compute[73208]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 09:09:37 user nova-compute[73208]:     <feature policy='require' name='vme'/>
Aug 16 09:09:37 user nova-compute[73208]:     <feature policy='require' name='x2apic'/>
Aug 16 09:09:37 user nova-compute[73208]:     <feature policy='require' name='hypervisor'/>
Aug 16 09:09:37 user nova-compute[73208]:   </cpu>
Aug 16 09:09:37 user nova-compute[73208]:   <clock offset='utc'>
Aug 16 09:09:37 user nova-compute[73208]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 09:09:37 user nova-compute[73208]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 09:09:37 user nova-compute[73208]:     <timer name='hpet' present='no'/>
Aug 16 09:09:37 user nova-compute[73208]:   </clock>
Aug 16 09:09:37 user nova-compute[73208]:   <on_poweroff>destroy</on_poweroff>
Aug 16 09:09:37 user nova-compute[73208]:   <on_reboot>restart</on_reboot>
Aug 16 09:09:37 user nova-compute[73208]:   <on_crash>destroy</on_crash>
Aug 16 09:09:37 user nova-compute[73208]:   <devices>
Aug 16 09:09:37 user nova-compute[73208]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 09:09:37 user nova-compute[73208]:     <disk type='file' device='disk'>
Aug 16 09:09:37 user nova-compute[73208]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 09:09:37 user nova-compute[73208]:       <source file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk' index='2'/>
Aug 16 09:09:37 user nova-compute[73208]:       <backingStore type='file' index='3'>
Aug 16 09:09:37 user nova-compute[73208]:         <format type='raw'/>
Aug 16 09:09:37 user nova-compute[73208]:         <source file='/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484'/>
Aug 16 09:09:37 user nova-compute[73208]:         <backingStore/>
Aug 16 09:09:37 user nova-compute[73208]:       </backingStore>
Aug 16 09:09:37 user nova-compute[73208]:       <target dev='vda' bus='virtio'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='virtio-disk0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </disk>
Aug 16 09:09:37 user nova-compute[73208]:     <disk type='file' device='cdrom'>
Aug 16 09:09:37 user nova-compute[73208]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 09:09:37 user nova-compute[73208]:       <source file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk.config' index='1'/>
Aug 16 09:09:37 user nova-compute[73208]:       <backingStore/>
Aug 16 09:09:37 user nova-compute[73208]:       <target dev='hda' bus='ide'/>
Aug 16 09:09:37 user nova-compute[73208]:       <readonly/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='ide0-0-0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </disk>
Aug 16 09:09:37 user nova-compute[73208]:     <controller type='usb' index='0' model='none'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='usb'/>
Aug 16 09:09:37 user nova-compute[73208]:     </controller>
Aug 16 09:09:37 user nova-compute[73208]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='pci.0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </controller>
Aug 16 09:09:37 user nova-compute[73208]:     <controller type='ide' index='0'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='ide'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 09:09:37 user nova-compute[73208]:     </controller>
Aug 16 09:09:37 user nova-compute[73208]:     <interface type='ethernet'>
Aug 16 09:09:37 user nova-compute[73208]:       <mac address='fa:16:3e:c2:f8:7f'/>
Aug 16 09:09:37 user nova-compute[73208]:       <target dev='tap19a387ca-2e'/>
Aug 16 09:09:37 user nova-compute[73208]:       <model type='virtio'/>
Aug 16 09:09:37 user nova-compute[73208]:       <mtu size='1442'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='net0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </interface>
Aug 16 09:09:37 user nova-compute[73208]:     <serial type='pty'>
Aug 16 09:09:37 user nova-compute[73208]:       <source path='/dev/pts/6'/>
Aug 16 09:09:37 user nova-compute[73208]:       <log file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log' append='off'/>
Aug 16 09:09:37 user nova-compute[73208]:       <target type='isa-serial' port='0'>
Aug 16 09:09:37 user nova-compute[73208]:         <model name='isa-serial'/>
Aug 16 09:09:37 user nova-compute[73208]:       </target>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='serial0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </serial>
Aug 16 09:09:37 user nova-compute[73208]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 09:09:37 user nova-compute[73208]:       <source path='/dev/pts/6'/>
Aug 16 09:09:37 user nova-compute[73208]:       <log file='/opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/console.log' append='off'/>
Aug 16 09:09:37 user nova-compute[73208]:       <target type='serial' port='0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='serial0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </console>
Aug 16 09:09:37 user nova-compute[73208]:     <input type='mouse' bus='ps2'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='input0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </input>
Aug 16 09:09:37 user nova-compute[73208]:     <input type='keyboard' bus='ps2'>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='input1'/>
Aug 16 09:09:37 user nova-compute[73208]:     </input>
Aug 16 09:09:37 user nova-compute[73208]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 09:09:37 user nova-compute[73208]:       <listen type='address' address='0.0.0.0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </graphics>
Aug 16 09:09:37 user nova-compute[73208]:     <audio id='1' type='none'/>
Aug 16 09:09:37 user nova-compute[73208]:     <video>
Aug 16 09:09:37 user nova-compute[73208]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='video0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </video>
Aug 16 09:09:37 user nova-compute[73208]:     <memballoon model='virtio'>
Aug 16 09:09:37 user nova-compute[73208]:       <stats period='10'/>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='balloon0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </memballoon>
Aug 16 09:09:37 user nova-compute[73208]:     <rng model='virtio'>
Aug 16 09:09:37 user nova-compute[73208]:       <backend model='random'>/dev/urandom</backend>
Aug 16 09:09:37 user nova-compute[73208]:       <alias name='rng0'/>
Aug 16 09:09:37 user nova-compute[73208]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 09:09:37 user nova-compute[73208]:     </rng>
Aug 16 09:09:37 user nova-compute[73208]:   </devices>
Aug 16 09:09:37 user nova-compute[73208]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 09:09:37 user nova-compute[73208]:     <label>libvirt-341d90a7-086a-42ce-9c23-d3422883d13e</label>
Aug 16 09:09:37 user nova-compute[73208]:     <imagelabel>libvirt-341d90a7-086a-42ce-9c23-d3422883d13e</imagelabel>
Aug 16 09:09:37 user nova-compute[73208]:   </seclabel>
Aug 16 09:09:37 user nova-compute[73208]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 09:09:37 user nova-compute[73208]:     <label>+64055:+108</label>
Aug 16 09:09:37 user nova-compute[73208]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 09:09:37 user nova-compute[73208]:   </seclabel>
Aug 16 09:09:37 user nova-compute[73208]: </domain>
Aug 16 09:09:37 user nova-compute[73208]:  {{(pid=73208) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 09:09:37 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Detaching interface fa:16:3e:00:73:1a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2a212149-e8' not found.
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] Converting VIF {"id": "2a212149-e8a4-4161-8258-81abbe2861e5", "address": "fa:16:3e:00:73:1a", "network": {"id": "5cdf2229-9c27-45ca-8359-2f6426a0b2cf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604993425", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a212149-e8", "ovs_interfaceid": "2a212149-e8a4-4161-8258-81abbe2861e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG os_vif [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a212149-e8, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:09:37 user nova-compute[73208]: INFO os_vif [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:73:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a212149-e8a4-4161-8258-81abbe2861e5,network=Network(5cdf2229-9c27-45ca-8359-2f6426a0b2cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a212149-e8')
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [req-b0bd2434-4ab5-49f7-bdd1-63135d563207 req-2224ff54-8646-4208-a204-ac74372e2807 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:09:37 user nova-compute[73208]:   <nova:package version="0.0.0"/>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:name>tempest-device-tagging-server-618417393</nova:name>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:creationTime>2023-08-16 09:09:37</nova:creationTime>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:flavor name="m1.tiny">
Aug 16 09:09:37 user nova-compute[73208]:     <nova:memory>512</nova:memory>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:disk>1</nova:disk>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:swap>0</nova:swap>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:vcpus>1</nova:vcpus>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:flavor>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:owner>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:user uuid="47c19f8b4a714169ba98d35d751dafd7">tempest-TaggedAttachmentsTest-2091015158-project-member</nova:user>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:project uuid="293a0d6bce9943868579b6b88a526f2b">tempest-TaggedAttachmentsTest-2091015158</nova:project>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:owner>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:09:37 user nova-compute[73208]:   <nova:ports>
Aug 16 09:09:37 user nova-compute[73208]:     <nova:port uuid="19a387ca-2e14-4170-947a-5f2b5f1f9bf1">
Aug 16 09:09:37 user nova-compute[73208]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:09:37 user nova-compute[73208]:     </nova:port>
Aug 16 09:09:37 user nova-compute[73208]:   </nova:ports>
Aug 16 09:09:37 user nova-compute[73208]: </nova:instance>
Aug 16 09:09:37 user nova-compute[73208]:  {{(pid=73208) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [{"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Releasing lock "refresh_cache-341d90a7-086a-42ce-9c23-d3422883d13e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:09:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ee32e646-6e81-4a11-8fe9-3804c93c1609 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "interface-341d90a7-086a-42ce-9c23-d3422883d13e-2a212149-e8a4-4161-8258-81abbe2861e5" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.427s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-af99ee1e-a58a-41e9-96e4-b39891581a7e req-6ae60341-cffb-475b-b2ed-defdc63537af service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-af99ee1e-a58a-41e9-96e4-b39891581a7e req-6ae60341-cffb-475b-b2ed-defdc63537af service nova] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-af99ee1e-a58a-41e9-96e4-b39891581a7e req-6ae60341-cffb-475b-b2ed-defdc63537af service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-af99ee1e-a58a-41e9-96e4-b39891581a7e req-6ae60341-cffb-475b-b2ed-defdc63537af service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-af99ee1e-a58a-41e9-96e4-b39891581a7e req-6ae60341-cffb-475b-b2ed-defdc63537af service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] No waiting events found dispatching network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:39 user nova-compute[73208]: WARNING nova.compute.manager [req-af99ee1e-a58a-41e9-96e4-b39891581a7e req-6ae60341-cffb-475b-b2ed-defdc63537af service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received unexpected event network-vif-plugged-2a212149-e8a4-4161-8258-81abbe2861e5 for instance with vm_state active and task_state None.
Aug 16 09:09:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "0fb21b62-0a07-426e-983e-86a33994b653" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "0fb21b62-0a07-426e-983e-86a33994b653" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "0fb21b62-0a07-426e-983e-86a33994b653-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:42 user nova-compute[73208]: INFO nova.compute.manager [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Terminating instance
Aug 16 09:09:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-40be3451-1e03-4f2b-b456-35f27b23d540 req-fad41e6a-f06d-4d85-86b4-4e5dd804a6eb service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-changed-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-40be3451-1e03-4f2b-b456-35f27b23d540 req-fad41e6a-f06d-4d85-86b4-4e5dd804a6eb service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing instance network info cache due to event network-changed-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40be3451-1e03-4f2b-b456-35f27b23d540 req-fad41e6a-f06d-4d85-86b4-4e5dd804a6eb service nova] Acquiring lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40be3451-1e03-4f2b-b456-35f27b23d540 req-fad41e6a-f06d-4d85-86b4-4e5dd804a6eb service nova] Acquired lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG nova.network.neutron [req-40be3451-1e03-4f2b-b456-35f27b23d540 req-fad41e6a-f06d-4d85-86b4-4e5dd804a6eb service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Refreshing network info cache for port 5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.network.neutron [req-40be3451-1e03-4f2b-b456-35f27b23d540 req-fad41e6a-f06d-4d85-86b4-4e5dd804a6eb service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updated VIF entry in instance network info cache for port 5b9c094e-ebb8-4e0a-81b2-b375ad98cc05. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.network.neutron [req-40be3451-1e03-4f2b-b456-35f27b23d540 req-fad41e6a-f06d-4d85-86b4-4e5dd804a6eb service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [{"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40be3451-1e03-4f2b-b456-35f27b23d540 req-fad41e6a-f06d-4d85-86b4-4e5dd804a6eb service nova] Releasing lock "refresh_cache-9333a6d0-50a9-456a-8948-6f0f20ed8b45" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-7a407335-8402-4fbc-a451-9a38a970d426 req-cce1764c-2723-4147-a8cd-f220a9e44475 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received event network-vif-unplugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7a407335-8402-4fbc-a451-9a38a970d426 req-cce1764c-2723-4147-a8cd-f220a9e44475 service nova] Acquiring lock "0fb21b62-0a07-426e-983e-86a33994b653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7a407335-8402-4fbc-a451-9a38a970d426 req-cce1764c-2723-4147-a8cd-f220a9e44475 service nova] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7a407335-8402-4fbc-a451-9a38a970d426 req-cce1764c-2723-4147-a8cd-f220a9e44475 service nova] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-7a407335-8402-4fbc-a451-9a38a970d426 req-cce1764c-2723-4147-a8cd-f220a9e44475 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] No waiting events found dispatching network-vif-unplugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-7a407335-8402-4fbc-a451-9a38a970d426 req-cce1764c-2723-4147-a8cd-f220a9e44475 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received event network-vif-unplugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Instance destroyed successfully.
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lazy-loading 'resources' on Instance uuid 0fb21b62-0a07-426e-983e-86a33994b653 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1822706582',display_name='tempest-VolumesNegativeTest-instance-1822706582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1822706582',id=11,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:08:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35b2da7c2dbb45718eb517187814aceb',ramdisk_id='',reservation_id='r-yd3qzc3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1590915018',owner_user_name='tempest-VolumesNegativeTest-1590915018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:01Z,user_data=None,user_id='3089374bc7e6494ebafa5c1da64c77d5',uuid=0fb21b62-0a07-426e-983e-86a33994b653,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Converting VIF {"id": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "address": "fa:16:3e:dc:56:38", "network": {"id": "528760da-85a5-4c5f-9b78-3234efc0347a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9a105ce3e8db43af8a5ec03d265e8d3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2af9033-c7", "ovs_interfaceid": "d2af9033-c76a-4e5f-9927-07ae3b64e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:56:38,bridge_name='br-int',has_traffic_filtering=True,id=d2af9033-c76a-4e5f-9927-07ae3b64e32e,network=Network(528760da-85a5-4c5f-9b78-3234efc0347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2af9033-c7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG os_vif [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:56:38,bridge_name='br-int',has_traffic_filtering=True,id=d2af9033-c76a-4e5f-9927-07ae3b64e32e,network=Network(528760da-85a5-4c5f-9b78-3234efc0347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2af9033-c7') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2af9033-c7, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:43 user nova-compute[73208]: INFO os_vif [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:56:38,bridge_name='br-int',has_traffic_filtering=True,id=d2af9033-c76a-4e5f-9927-07ae3b64e32e,network=Network(528760da-85a5-4c5f-9b78-3234efc0347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2af9033-c7')
Aug 16 09:09:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Deleting instance files /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653_del
Aug 16 09:09:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Deletion of /opt/stack/data/nova/instances/0fb21b62-0a07-426e-983e-86a33994b653_del complete
Aug 16 09:09:43 user nova-compute[73208]: INFO nova.compute.manager [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 16 09:09:43 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:09:43 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:09:44 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:44 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Took 0.60 seconds to deallocate network for instance.
Aug 16 09:09:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-254ffac9-89fa-4b67-9783-f4ddf4dc9456 req-86d89482-6bff-4799-b60a-db3101af1ec9 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received event network-vif-deleted-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:44 user nova-compute[73208]: INFO nova.compute.manager [req-254ffac9-89fa-4b67-9783-f4ddf4dc9456 req-86d89482-6bff-4799-b60a-db3101af1ec9 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Neutron deleted interface d2af9033-c76a-4e5f-9927-07ae3b64e32e; detaching it from the instance and deleting it from the info cache
Aug 16 09:09:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-254ffac9-89fa-4b67-9783-f4ddf4dc9456 req-86d89482-6bff-4799-b60a-db3101af1ec9 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-254ffac9-89fa-4b67-9783-f4ddf4dc9456 req-86d89482-6bff-4799-b60a-db3101af1ec9 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Detach interface failed, port_id=d2af9033-c76a-4e5f-9927-07ae3b64e32e, reason: Instance 0fb21b62-0a07-426e-983e-86a33994b653 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:09:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:44 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:09:44 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:09:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:44 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Deleted allocations for instance 0fb21b62-0a07-426e-983e-86a33994b653
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c40a30c1-7245-4e15-a789-ce7691cff195 tempest-VolumesNegativeTest-1590915018 tempest-VolumesNegativeTest-1590915018-project-member] Lock "0fb21b62-0a07-426e-983e-86a33994b653" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-68ad8e8f-5c50-420a-8772-fcb5e884a858 req-d81494f8-79ca-4044-93aa-2ee45bd98769 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received event network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-68ad8e8f-5c50-420a-8772-fcb5e884a858 req-d81494f8-79ca-4044-93aa-2ee45bd98769 service nova] Acquiring lock "0fb21b62-0a07-426e-983e-86a33994b653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-68ad8e8f-5c50-420a-8772-fcb5e884a858 req-d81494f8-79ca-4044-93aa-2ee45bd98769 service nova] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-68ad8e8f-5c50-420a-8772-fcb5e884a858 req-d81494f8-79ca-4044-93aa-2ee45bd98769 service nova] Lock "0fb21b62-0a07-426e-983e-86a33994b653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-68ad8e8f-5c50-420a-8772-fcb5e884a858 req-d81494f8-79ca-4044-93aa-2ee45bd98769 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] No waiting events found dispatching network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:45 user nova-compute[73208]: WARNING nova.compute.manager [req-68ad8e8f-5c50-420a-8772-fcb5e884a858 req-d81494f8-79ca-4044-93aa-2ee45bd98769 service nova] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Received unexpected event network-vif-plugged-d2af9033-c76a-4e5f-9927-07ae3b64e32e for instance with vm_state deleted and task_state None.
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:45 user nova-compute[73208]: INFO nova.compute.manager [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Terminating instance
Aug 16 09:09:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-27004cfe-24db-41aa-abad-3fa17e828a37 req-126e673c-5c1c-4fa1-be9f-092f06eed58c service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-27004cfe-24db-41aa-abad-3fa17e828a37 req-126e673c-5c1c-4fa1-be9f-092f06eed58c service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-27004cfe-24db-41aa-abad-3fa17e828a37 req-126e673c-5c1c-4fa1-be9f-092f06eed58c service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-27004cfe-24db-41aa-abad-3fa17e828a37 req-126e673c-5c1c-4fa1-be9f-092f06eed58c service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-27004cfe-24db-41aa-abad-3fa17e828a37 req-126e673c-5c1c-4fa1-be9f-092f06eed58c service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-unplugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-27004cfe-24db-41aa-abad-3fa17e828a37 req-126e673c-5c1c-4fa1-be9f-092f06eed58c service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-885f49f2-dce0-4281-9eca-a2e8f0dd0ed2 req-d9498b98-40d8-444d-b4ef-756f37f4f21a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-885f49f2-dce0-4281-9eca-a2e8f0dd0ed2 req-d9498b98-40d8-444d-b4ef-756f37f4f21a service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-885f49f2-dce0-4281-9eca-a2e8f0dd0ed2 req-d9498b98-40d8-444d-b4ef-756f37f4f21a service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-885f49f2-dce0-4281-9eca-a2e8f0dd0ed2 req-d9498b98-40d8-444d-b4ef-756f37f4f21a service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-885f49f2-dce0-4281-9eca-a2e8f0dd0ed2 req-d9498b98-40d8-444d-b4ef-756f37f4f21a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-unplugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-885f49f2-dce0-4281-9eca-a2e8f0dd0ed2 req-d9498b98-40d8-444d-b4ef-756f37f4f21a service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-c79d7904-27c5-4ea6-8772-a74d8b687d03 req-edb4b212-ad3c-4aaf-8faa-cbdabdaab22e service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received event volume-reimaged-d37615d3-44d4-4152-8d90-d480a38c255d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c79d7904-27c5-4ea6-8772-a74d8b687d03 req-edb4b212-ad3c-4aaf-8faa-cbdabdaab22e service nova] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c79d7904-27c5-4ea6-8772-a74d8b687d03 req-edb4b212-ad3c-4aaf-8faa-cbdabdaab22e service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c79d7904-27c5-4ea6-8772-a74d8b687d03 req-edb4b212-ad3c-4aaf-8faa-cbdabdaab22e service nova] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-c79d7904-27c5-4ea6-8772-a74d8b687d03 req-edb4b212-ad3c-4aaf-8faa-cbdabdaab22e service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Processing event volume-reimaged-d37615d3-44d4-4152-8d90-d480a38c255d {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:09:46 user nova-compute[73208]: INFO nova.virt.block_device [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Booting with volume d37615d3-44d4-4152-8d90-d480a38c255d at /dev/vda
Aug 16 09:09:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG os_brick.utils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca5407d-9eb8-4228-9c70-7770b71db499]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5a56ac-e124-4255-90fd-cfb0f3ed81d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eee0dc-1a29-40b2-a568-944dfc4cc19f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5af97e5-6778-426e-bb35-d0855d440c4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:09:47 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf74d234-dd59-412a-8cba-618300c23181]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.utils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updating existing volume attachment record: 63c8dfe4-8e53-49f5-951d-a2cc3d8882af {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:09:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Instance destroyed successfully.
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lazy-loading 'resources' on Instance uuid 9333a6d0-50a9-456a-8948-6f0f20ed8b45 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:44:e6,bridge_name='br-int',has_traffic_filtering=True,id=5b9c094e-ebb8-4e0a-81b2-b375ad98cc05,network=Network(afaa9554-c213-49c8-8f78-6003892349b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b9c094e-eb') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:44:e6,bridge_name='br-int',has_traffic_filtering=True,id=5b9c094e-ebb8-4e0a-81b2-b375ad98cc05,network=Network(afaa9554-c213-49c8-8f78-6003892349b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b9c094e-eb') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b9c094e-eb, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: INFO os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:44:e6,bridge_name='br-int',has_traffic_filtering=True,id=5b9c094e-ebb8-4e0a-81b2-b375ad98cc05,network=Network(afaa9554-c213-49c8-8f78-6003892349b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b9c094e-eb')
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:5a:c2,bridge_name='br-int',has_traffic_filtering=True,id=8b77492c-96a5-4be1-99d4-eb060e5ef241,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b77492c-96') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:5a:c2,bridge_name='br-int',has_traffic_filtering=True,id=8b77492c-96a5-4be1-99d4-eb060e5ef241,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b77492c-96') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b77492c-96, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: INFO os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:5a:c2,bridge_name='br-int',has_traffic_filtering=True,id=8b77492c-96a5-4be1-99d4-eb060e5ef241,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b77492c-96')
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:54,bridge_name='br-int',has_traffic_filtering=True,id=ff69ee3b-5ba0-4da4-811e-eb1af566603d,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff69ee3b-5b') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:54,bridge_name='br-int',has_traffic_filtering=True,id=ff69ee3b-5ba0-4da4-811e-eb1af566603d,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff69ee3b-5b') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff69ee3b-5b, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-unplugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:47 user nova-compute[73208]: WARNING nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-ff69ee3b-5ba0-4da4-811e-eb1af566603d for instance with vm_state active and task_state deleting.
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-unplugged-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-5035b4ea-1ac0-45c7-a299-5277719d9fff for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:47 user nova-compute[73208]: WARNING nova.compute.manager [req-0abf5396-348f-483b-8545-dac310b28cb2 req-56935cf1-e9c4-41fe-b3a3-fecb5a7c6e3e service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-5035b4ea-1ac0-45c7-a299-5277719d9fff for instance with vm_state active and task_state deleting.
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: INFO os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:54,bridge_name='br-int',has_traffic_filtering=True,id=ff69ee3b-5ba0-4da4-811e-eb1af566603d,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff69ee3b-5b')
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=5035b4ea-1ac0-45c7-a299-5277719d9fff,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5035b4ea-1a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=5035b4ea-1ac0-45c7-a299-5277719d9fff,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5035b4ea-1a') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5035b4ea-1a, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: INFO os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=5035b4ea-1ac0-45c7-a299-5277719d9fff,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5035b4ea-1a')
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:56:87,bridge_name='br-int',has_traffic_filtering=True,id=6b64fd22-8774-490c-99cb-2f427c019ed5,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b64fd22-87') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:56:87,bridge_name='br-int',has_traffic_filtering=True,id=6b64fd22-8774-490c-99cb-2f427c019ed5,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b64fd22-87') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b64fd22-87, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: INFO os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:56:87,bridge_name='br-int',has_traffic_filtering=True,id=6b64fd22-8774-490c-99cb-2f427c019ed5,network=Network(27184ceb-959f-4e45-94b1-589bb3356769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b64fd22-87')
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8d:82,bridge_name='br-int',has_traffic_filtering=True,id=40fb0fe9-3e51-4a07-89a4-67267cc274b3,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40fb0fe9-3e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8d:82,bridge_name='br-int',has_traffic_filtering=True,id=40fb0fe9-3e51-4a07-89a4-67267cc274b3,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40fb0fe9-3e') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40fb0fe9-3e, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: INFO os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8d:82,bridge_name='br-int',has_traffic_filtering=True,id=40fb0fe9-3e51-4a07-89a4-67267cc274b3,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40fb0fe9-3e')
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1307880921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1307880921',id=10,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm/qb9zXRAWDAVGZMSvAzhbHw4EM8JeMX+llspLqj6FcyB64IM/F7fFer0p97EnOZTGlzW+pY14YM1in3nkkhB491oj4yFcsRr8/GQyhIlXo3eAC8mkwkX1wkOsZd/TrA==',key_name='tempest-keypair-107174842',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37047b551d54c728c6da706a88a7efb',ramdisk_id='',reservation_id='r-n4u0vogf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1301421956',owner_user_name='tempest-TaggedBootDevicesTest-1301421956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cedac6a6b631415fb63d0943cbfb1275',uuid=9333a6d0-50a9-456a-8948-6f0f20ed8b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converting VIF {"id": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "address": "fa:16:3e:3c:73:5f", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e03d2b-f6", "ovs_interfaceid": "43e03d2b-f637-424a-837b-7fe1b7f5c87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:73:5f,bridge_name='br-int',has_traffic_filtering=True,id=43e03d2b-f637-424a-837b-7fe1b7f5c87f,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e03d2b-f6') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:73:5f,bridge_name='br-int',has_traffic_filtering=True,id=43e03d2b-f637-424a-837b-7fe1b7f5c87f,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e03d2b-f6') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43e03d2b-f6, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:47 user nova-compute[73208]: INFO os_vif [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:73:5f,bridge_name='br-int',has_traffic_filtering=True,id=43e03d2b-f637-424a-837b-7fe1b7f5c87f,network=Network(7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e03d2b-f6')
Aug 16 09:09:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVxUJmro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:47 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[219bdac5-9a6d-4382-89cb-716eba8a817b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d28daf-a895-4138-990d-8616b39497c0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:47 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:47 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:47 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b (non-flash)
Aug 16 09:09:47 user nova-compute[73208]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:47 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:47 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d03cd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e22c9c-74db-42b1-b023-6d1c756a13e0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d016d5-6f72-4dd3-8a94-dd9513642f7e]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:09:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf66f9d-e713-4397-a7b6-f725247ac0e8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b6b00a-f17a-4fc8-a248-f9ac7469cdfb]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[29df6f7f-eca4-4620-8338-f5c330dfc742]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647bb60-b53e-4617-bba0-6224b80614f9]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b, portal: 172.16.0.220,3260]
Aug 16 09:09:48 user nova-compute[73208]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b1f550-0229-45c1-a34e-38731543d97b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5d7d59-c366-49c0-9c97-e61bf1b55433]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== disconnect_volume: return (292ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdLUpoZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:48 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[50634872-5544-4560-a2e4-fb91b4af23bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b706d1-737f-411f-908d-b8870aeb1438]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d03cd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc7202-30e1-4dbf-a0a3-d99a17d67a0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68d7832-3379-4c70-8218-14d4121b92d3]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a355dcf-b49a-48f5-8b74-f800bc65720b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df24926-0f3e-4b63-9606-5e8202e90415]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:48 user nova-compute[73208]: WARNING nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 for instance with vm_state active and task_state deleting.
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-unplugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:48 user nova-compute[73208]: WARNING nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-8b77492c-96a5-4be1-99d4-eb060e5ef241 for instance with vm_state active and task_state deleting.
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-unplugged-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-6b64fd22-8774-490c-99cb-2f427c019ed5 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:48 user nova-compute[73208]: WARNING nova.compute.manager [req-b850437e-b53f-49e3-a4ef-53efc8ff1484 req-6ff5c97c-f968-430a-8848-ff6b4ee20264 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-6b64fd22-8774-490c-99cb-2f427c019ed5 for instance with vm_state active and task_state deleting.
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d056fe2-3078-43dc-bec3-b6f6c8b76d6e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[58623e01-113f-4910-bae7-843e6ed3364f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4, portal: 172.16.0.220,3260]
Aug 16 09:09:48 user nova-compute[73208]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e63821-0b31-477d-829f-e39b45278dbf]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== disconnect_volume: return (264ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKwDrQlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:09:48 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bda8ead-cb1f-449b-87a2-eb0d8fcefd29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[665c0558-6328-4782-949e-2a9111f2713e]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:09:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d03cd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0'): ({'sde'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Removing single pathed devices sde {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b835c698-5ed3-489d-8da8-b0b43d79a7b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9426ef5-03a1-43e6-adf0-a1222e0db99a]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Flushing IO for device /dev/sde {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e734721-8948-4ae9-942f-062d1bf7ef46]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b66a547-86f4-40fb-a5d3-3c30cb92797e]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ce945b-a1f1-4ae7-9469-ca97bcb07593]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b048637-0e0b-4cd9-85db-751823eda796]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0, portal: 172.16.0.220,3260]
Aug 16 09:09:48 user nova-compute[73208]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0, portal: 172.16.0.220,3260] successful.
Aug 16 09:09:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:48 user nova-compute[73208]: WARNING nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-40fb0fe9-3e51-4a07-89a4-67267cc274b3 for instance with vm_state active and task_state deleting.
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-unplugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-unplugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Acquiring lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] No waiting events found dispatching network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:09:48 user nova-compute[73208]: WARNING nova.compute.manager [req-14ce7c2b-6a93-46d7-8845-1489a3f822b2 req-eabfdddf-4730-4add-a50d-45ee0640d880 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received unexpected event network-vif-plugged-43e03d2b-f637-424a-837b-7fe1b7f5c87f for instance with vm_state active and task_state deleting.
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fabe78cc-5dbc-4aa2-bbb1-177d15a158f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb72bb4-0c3a-40c8-bbbc-50889fb7e790]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] <== disconnect_volume: return (279ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:09:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Deleting instance files /opt/stack/data/nova/instances/9333a6d0-50a9-456a-8948-6f0f20ed8b45_del
Aug 16 09:09:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Deletion of /opt/stack/data/nova/instances/9333a6d0-50a9-456a-8948-6f0f20ed8b45_del complete
Aug 16 09:09:48 user nova-compute[73208]: INFO nova.compute.manager [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Took 3.23 seconds to destroy the instance on the hypervisor.
Aug 16 09:09:48 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:09:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-d548ee1c-208c-46f6-a7e9-3cb40e310f7a req-2b5896cb-f764-4024-9f7f-b66fdd903be8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-deleted-43e03d2b-f637-424a-837b-7fe1b7f5c87f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:51 user nova-compute[73208]: INFO nova.compute.manager [req-d548ee1c-208c-46f6-a7e9-3cb40e310f7a req-2b5896cb-f764-4024-9f7f-b66fdd903be8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Neutron deleted interface 43e03d2b-f637-424a-837b-7fe1b7f5c87f; detaching it from the instance and deleting it from the info cache
Aug 16 09:09:51 user nova-compute[73208]: DEBUG nova.network.neutron [req-d548ee1c-208c-46f6-a7e9-3cb40e310f7a req-2b5896cb-f764-4024-9f7f-b66fdd903be8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [{"id": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "address": "fa:16:3e:08:44:e6", "network": {"id": "afaa9554-c213-49c8-8f78-6003892349b9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-345426526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b9c094e-eb", "ovs_interfaceid": "5b9c094e-ebb8-4e0a-81b2-b375ad98cc05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "address": "fa:16:3e:07:5a:c2", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b77492c-96", "ovs_interfaceid": "8b77492c-96a5-4be1-99d4-eb060e5ef241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "address": "fa:16:3e:86:5c:54", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69ee3b-5b", "ovs_interfaceid": "ff69ee3b-5ba0-4da4-811e-eb1af566603d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "address": "fa:16:3e:33:f8:14", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5035b4ea-1a", "ovs_interfaceid": "5035b4ea-1ac0-45c7-a299-5277719d9fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b64fd22-8774-490c-99cb-2f427c019ed5", "address": "fa:16:3e:19:56:87", "network": {"id": "27184ceb-959f-4e45-94b1-589bb3356769", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069463728", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b64fd22-87", "ovs_interfaceid": "6b64fd22-8774-490c-99cb-2f427c019ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "address": "fa:16:3e:cc:8d:82", "network": {"id": "7dd0eef4-6a96-4ded-91e6-ec4fcff5fd5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1250335028", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d37047b551d54c728c6da706a88a7efb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40fb0fe9-3e", "ovs_interfaceid": "40fb0fe9-3e51-4a07-89a4-67267cc274b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-d548ee1c-208c-46f6-a7e9-3cb40e310f7a req-2b5896cb-f764-4024-9f7f-b66fdd903be8 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Detach interface failed, port_id=43e03d2b-f637-424a-837b-7fe1b7f5c87f, reason: Instance 9333a6d0-50a9-456a-8948-6f0f20ed8b45 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:09:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:09:53 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:09:53 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Took 4.68 seconds to deallocate network for instance.
Aug 16 09:09:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-d536931e-9f3e-4048-ae48-bcbce7058e21 req-01e9142a-efad-48df-9649-2739aa7b7db0 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-deleted-5b9c094e-ebb8-4e0a-81b2-b375ad98cc05 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-d536931e-9f3e-4048-ae48-bcbce7058e21 req-01e9142a-efad-48df-9649-2739aa7b7db0 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-deleted-6b64fd22-8774-490c-99cb-2f427c019ed5 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-d536931e-9f3e-4048-ae48-bcbce7058e21 req-01e9142a-efad-48df-9649-2739aa7b7db0 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-deleted-5035b4ea-1ac0-45c7-a299-5277719d9fff {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-d536931e-9f3e-4048-ae48-bcbce7058e21 req-01e9142a-efad-48df-9649-2739aa7b7db0 service nova] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Received event network-vif-deleted-40fb0fe9-3e51-4a07-89a4-67267cc274b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.volume.cinder [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Update attachment failed for attachment 63c8dfe4-8e53-49f5-951d-a2cc3d8882af. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Traceback (most recent call last):
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self.driver.rebuild(**kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     raise NotImplementedError()
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] NotImplementedError
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] 
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] During handling of the above exception, another exception occurred:
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] 
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Traceback (most recent call last):
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     driver_block_device.attach_block_devices(
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     _log_and_attach(device)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     bdm.attach(*attach_args, **attach_kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     ret_val = method(obj, context, *args, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self._do_attach(context, instance, volume, volume_api,
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self._volume_attach(context, volume, connector, instance,
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     connection_info = volume_api.attachment_update(
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     res = method(self, ctx, *args, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     with excutils.save_and_reraise_exception():
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self.force_reraise()
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     raise self.value
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     return method.func(obj, *args, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     resp = self._update('/attachments/%s' % id, body)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     return self.request(url, method, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     raise exceptions.from_response(resp, body)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] 
Aug 16 09:09:55 user nova-compute[73208]: DEBUG nova.compute.utils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi {{(pid=73208) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Traceback (most recent call last):
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self.driver.rebuild(**kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     raise NotImplementedError()
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] NotImplementedError
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] 
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] During handling of the above exception, another exception occurred:
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] 
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Traceback (most recent call last):
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     driver_block_device.attach_block_devices(
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     _log_and_attach(device)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     bdm.attach(*attach_args, **attach_kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     ret_val = method(obj, context, *args, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self._do_attach(context, instance, volume, volume_api,
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self._volume_attach(context, volume, connector, instance,
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     connection_info = volume_api.attachment_update(
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     res = method(self, ctx, *args, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     with excutils.save_and_reraise_exception():
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self.force_reraise()
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     raise self.value
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     return method.func(obj, *args, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     resp = self._update('/attachments/%s' % id, body)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     return self.request(url, method, **kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     raise exceptions.from_response(resp, body)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] 
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] During handling of the above exception, another exception occurred:
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] 
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Traceback (most recent call last):
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 10766, in _error_out_instance_on_exception
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     yield
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 3841, in rebuild_instance
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self._do_rebuild_instance_with_claim(
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 3927, in _do_rebuild_instance_with_claim
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self._do_rebuild_instance(
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 4119, in _do_rebuild_instance
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     self._rebuild_default_impl(**kwargs)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 3703, in _rebuild_default_impl
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     new_block_device_info = attach_block_devices(context, instance, bdms)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]   File "/opt/stack/nova/nova/compute/manager.py", line 2193, in _prep_block_device
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170]     raise exception.InvalidBDM(str(ex))
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:55 user nova-compute[73208]: ERROR nova.compute.manager [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] 
Aug 16 09:09:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:56 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:09:56 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:09:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:56 user nova-compute[73208]: INFO nova.compute.manager [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server [None req-c79d7904-27c5-4ea6-8772-a74d8b687d03 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server NotImplementedError
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3841, in rebuild_instance
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3927, in _do_rebuild_instance_with_claim
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4119, in _do_rebuild_instance
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3703, in _rebuild_default_impl
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2193, in _prep_block_device
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3fc2da6d-f3dc-4741-a70e-a90dd608aea4 was not found.).). (HTTP 500) (Request-ID: req-ffccd372-cf61-4224-9017-df3e9c97ee47)
Aug 16 09:09:56 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:09:56 user nova-compute[73208]: INFO nova.compute.manager [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Took 2.75 seconds to detach 3 volumes for instance.
Aug 16 09:09:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:09:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:09:56 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:09:56 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:09:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:56 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Deleted allocations for instance 9333a6d0-50a9-456a-8948-6f0f20ed8b45
Aug 16 09:09:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca6e3bc3-beb3-47fa-b87a-a479eb527403 tempest-TaggedBootDevicesTest-1301421956 tempest-TaggedBootDevicesTest-1301421956-project-member] Lock "9333a6d0-50a9-456a-8948-6f0f20ed8b45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.105s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:09:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:09:58 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692176983.6202562, 0fb21b62-0a07-426e-983e-86a33994b653 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:09:58 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] VM Stopped (Lifecycle Event)
Aug 16 09:09:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e07265ae-111c-4e80-bc65-2a5cb14be608 None None] [instance: 0fb21b62-0a07-426e-983e-86a33994b653] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:02 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692176987.4425592, 9333a6d0-50a9-456a-8948-6f0f20ed8b45 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:10:02 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] VM Stopped (Lifecycle Event)
Aug 16 09:10:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-869e8cfb-c1be-457f-bf78-4cd4f4aae8c0 None None] [instance: 9333a6d0-50a9-456a-8948-6f0f20ed8b45] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:10:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:10:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:10:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "9b4f9560-9aae-4591-9037-c76c1504f170" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "9b4f9560-9aae-4591-9037-c76c1504f170-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:08 user nova-compute[73208]: INFO nova.compute.manager [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Terminating instance
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] During wait destroy, instance disappeared. {{(pid=73208) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1517}}
Aug 16 09:10:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Instance destroyed successfully.
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.objects.instance [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lazy-loading 'resources' on Instance uuid 9b4f9560-9aae-4591-9037-c76c1504f170 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-189156513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2135176385',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqVMHp97P9ublYenAcgiSOc9ytp+GzRvrXFO7o7iJo+WF+qpCY0zMqmhKHd0j/TNreM8QuEhFCVAjULrP8OMq5bCydKoV0CuzEeL7alWBhWv+5yB6zpO1Fk0vqcEP3NTA==',key_name='tempest-keypair-216633937',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e2b7d360dd490e92b4059046b5dbac',ramdisk_id='',reservation_id='r-2rx0673y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-945797344',owner_user_name='tempest-ServerActionsV293TestJSON-945797344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:09:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb4f290b3a9d41f0830720605ea7e601',uuid=9b4f9560-9aae-4591-9037-c76c1504f170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Converting VIF {"id": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "address": "fa:16:3e:3b:09:45", "network": {"id": "324fd9f6-1c99-468b-8d0f-019602fdb6d4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-629668444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e2b7d360dd490e92b4059046b5dbac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f4f751-4d", "ovs_interfaceid": "91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_vif [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f4f751-4d, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:10:08 user nova-compute[73208]: INFO os_vif [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:09:45,bridge_name='br-int',has_traffic_filtering=True,id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4,network=Network(324fd9f6-1c99-468b-8d0f-019602fdb6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f4f751-4d')
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoJpVtzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:10:08 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37615d3-44d4-4152-8d90-d480a38c255d', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[960a5216-383b-4def-9c0a-347378cbdd71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ad2e1-f812-4190-8c3f-68b2d32623e6]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:08 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:08 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0371240>, {}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Disconnecting from: [] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] <== disconnect_volume: return (45ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:10:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Deletion of /opt/stack/data/nova/instances/9b4f9560-9aae-4591-9037-c76c1504f170_del complete
Aug 16 09:10:08 user nova-compute[73208]: INFO nova.compute.manager [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Took 0.15 seconds to destroy the instance on the hypervisor.
Aug 16 09:10:08 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:10:08 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:10:09 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:09 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Took 1.10 seconds to deallocate network for instance.
Aug 16 09:10:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-67293ab1-249c-44b9-8f5a-0d3a8b6df123 req-eea550ad-ff08-43c3-bf21-8c6019505f5e service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Received event network-vif-deleted-91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:09 user nova-compute[73208]: INFO nova.compute.manager [req-67293ab1-249c-44b9-8f5a-0d3a8b6df123 req-eea550ad-ff08-43c3-bf21-8c6019505f5e service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Neutron deleted interface 91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4; detaching it from the instance and deleting it from the info cache
Aug 16 09:10:09 user nova-compute[73208]: DEBUG nova.network.neutron [req-67293ab1-249c-44b9-8f5a-0d3a8b6df123 req-eea550ad-ff08-43c3-bf21-8c6019505f5e service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-67293ab1-249c-44b9-8f5a-0d3a8b6df123 req-eea550ad-ff08-43c3-bf21-8c6019505f5e service nova] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Detach interface failed, port_id=91f4f751-4d7a-47f1-8272-a9a2e4c0d4e4, reason: Instance 9b4f9560-9aae-4591-9037-c76c1504f170 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:10:10 user nova-compute[73208]: INFO nova.compute.manager [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Took 0.11 seconds to detach 1 volumes for instance.
Aug 16 09:10:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] [instance: 9b4f9560-9aae-4591-9037-c76c1504f170] Deleting volume: d37615d3-44d4-4152-8d90-d480a38c255d {{(pid=73208) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 09:10:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:10 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:10:10 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:10:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-017cba20-5f9e-40aa-b8b3-dd5ec085fe28 tempest-ServerActionsV293TestJSON-945797344 tempest-ServerActionsV293TestJSON-945797344-project-member] Lock "9b4f9560-9aae-4591-9037-c76c1504f170" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.841s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:11 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4165-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:10:16 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:16 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:16 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:16 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:16 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:18 user nova-compute[73208]: INFO nova.compute.manager [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Terminating instance
Aug 16 09:10:18 user nova-compute[73208]: DEBUG nova.compute.manager [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-d83c8233-33b8-4f5f-88c6-d725eb84322a req-367b2379-131c-448f-86f4-a5a70ef9205d service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received event network-vif-unplugged-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d83c8233-33b8-4f5f-88c6-d725eb84322a req-367b2379-131c-448f-86f4-a5a70ef9205d service nova] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d83c8233-33b8-4f5f-88c6-d725eb84322a req-367b2379-131c-448f-86f4-a5a70ef9205d service nova] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d83c8233-33b8-4f5f-88c6-d725eb84322a req-367b2379-131c-448f-86f4-a5a70ef9205d service nova] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-d83c8233-33b8-4f5f-88c6-d725eb84322a req-367b2379-131c-448f-86f4-a5a70ef9205d service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] No waiting events found dispatching network-vif-unplugged-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-d83c8233-33b8-4f5f-88c6-d725eb84322a req-367b2379-131c-448f-86f4-a5a70ef9205d service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received event network-vif-unplugged-d5f33513-9c06-4d4c-80ae-96d56600b971 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Instance destroyed successfully.
Aug 16 09:10:19 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:10:19 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8266MB free_disk=25.814964294433594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.objects.instance [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lazy-loading 'resources' on Instance uuid 77d077df-579d-4d9d-b76b-14d5d0a0d26f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2019339522',display_name='tempest-VolumesAssistedSnapshotsTest-server-2019339522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2019339522',id=8,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmvT+9+EUPxAUKZAkHd65XMwZqcFdTUEdTrTInLHh3mgSkt45KZLVseP8SrbbN35VL7IRGiXzyfHRGqcrvfynjD2SMKY7u454v0hbe/w2npFAbAMS5U+GCHo9wYVFR4HQ==',key_name='tempest-keypair-1694979867',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb3a2cc196d34f7cb74536a37f78f69c',ramdisk_id='',reservation_id='r-yusrxhdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998796937',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998796937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2274361da342cdb881b2721d45d715',uuid=77d077df-579d-4d9d-b76b-14d5d0a0d26f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Converting VIF {"id": "d5f33513-9c06-4d4c-80ae-96d56600b971", "address": "fa:16:3e:8b:4b:16", "network": {"id": "3ad6a26f-5346-4047-9c3d-3d119de2ab51", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1938138527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb3a2cc196d34f7cb74536a37f78f69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f33513-9c", "ovs_interfaceid": "d5f33513-9c06-4d4c-80ae-96d56600b971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4b:16,bridge_name='br-int',has_traffic_filtering=True,id=d5f33513-9c06-4d4c-80ae-96d56600b971,network=Network(3ad6a26f-5346-4047-9c3d-3d119de2ab51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f33513-9c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG os_vif [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4b:16,bridge_name='br-int',has_traffic_filtering=True,id=d5f33513-9c06-4d4c-80ae-96d56600b971,network=Network(3ad6a26f-5346-4047-9c3d-3d119de2ab51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f33513-9c') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5f33513-9c, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:19 user nova-compute[73208]: INFO os_vif [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4b:16,bridge_name='br-int',has_traffic_filtering=True,id=d5f33513-9c06-4d4c-80ae-96d56600b971,network=Network(3ad6a26f-5346-4047-9c3d-3d119de2ab51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f33513-9c')
Aug 16 09:10:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Deleting instance files /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f_del
Aug 16 09:10:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Deletion of /opt/stack/data/nova/instances/77d077df-579d-4d9d-b76b-14d5d0a0d26f_del complete
Aug 16 09:10:19 user nova-compute[73208]: INFO nova.compute.manager [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 16 09:10:19 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 341d90a7-086a-42ce-9c23-d3422883d13e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:10:19 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:10:20 user nova-compute[73208]: INFO nova.compute.claims [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Claim successful on node user
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:20 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Took 1.10 seconds to deallocate network for instance.
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-30e6fdd6-0c67-4536-92ec-083c7e5cc4ac req-a0716a1b-9b23-4982-92de-8eb407be1763 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received event network-vif-deleted-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:20 user nova-compute[73208]: INFO nova.compute.manager [req-30e6fdd6-0c67-4536-92ec-083c7e5cc4ac req-a0716a1b-9b23-4982-92de-8eb407be1763 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Neutron deleted interface d5f33513-9c06-4d4c-80ae-96d56600b971; detaching it from the instance and deleting it from the info cache
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.network.neutron [req-30e6fdd6-0c67-4536-92ec-083c7e5cc4ac req-a0716a1b-9b23-4982-92de-8eb407be1763 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-30e6fdd6-0c67-4536-92ec-083c7e5cc4ac req-a0716a1b-9b23-4982-92de-8eb407be1763 service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Detach interface failed, port_id=d5f33513-9c06-4d4c-80ae-96d56600b971, reason: Instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:10:20 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:10:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-c8e6f63a-7b0d-4e48-b61b-ac5ede06fc9c req-72c3e27f-2914-45cc-887d-eaf164f90b6f service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received event network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8e6f63a-7b0d-4e48-b61b-ac5ede06fc9c req-72c3e27f-2914-45cc-887d-eaf164f90b6f service nova] Acquiring lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8e6f63a-7b0d-4e48-b61b-ac5ede06fc9c req-72c3e27f-2914-45cc-887d-eaf164f90b6f service nova] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8e6f63a-7b0d-4e48-b61b-ac5ede06fc9c req-72c3e27f-2914-45cc-887d-eaf164f90b6f service nova] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-c8e6f63a-7b0d-4e48-b61b-ac5ede06fc9c req-72c3e27f-2914-45cc-887d-eaf164f90b6f service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] No waiting events found dispatching network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:21 user nova-compute[73208]: WARNING nova.compute.manager [req-c8e6f63a-7b0d-4e48-b61b-ac5ede06fc9c req-72c3e27f-2914-45cc-887d-eaf164f90b6f service nova] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Received unexpected event network-vif-plugged-d5f33513-9c06-4d4c-80ae-96d56600b971 for instance with vm_state deleted and task_state None.
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.policy [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e351e35970aa48028ad400bbda5403b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62017e5fe324a528f4ad1dc5c939498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:10:21 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Creating image(s)
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.215s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:21 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Deleted allocations for instance 77d077df-579d-4d9d-b76b-14d5d0a0d26f
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00125300-cfff-46df-9662-cf7ab0fc8b03 tempest-VolumesAssistedSnapshotsTest-998796937 tempest-VolumesAssistedSnapshotsTest-998796937-project-member] Lock "77d077df-579d-4d9d-b76b-14d5d0a0d26f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.065s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk 1073741824" returned: 0 in 0.054s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:10:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Cannot resize image /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG nova.objects.instance [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'migration_context' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Ensure instance console log exists: /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG nova.network.neutron [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Successfully created port: 5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:22 user nova-compute[73208]: INFO nova.compute.manager [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Unshelving
Aug 16 09:10:22 user nova-compute[73208]: INFO nova.virt.block_device [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Booting with volume f67a4b7d-0350-4190-bc4a-a8e66fcea658 at /dev/vdc
Aug 16 09:10:22 user nova-compute[73208]: DEBUG os_brick.utils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffac2d06-3b8e-4fde-9cfc-d7841fe7b221]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec9fb9f-9fd5-407f-b154-dbbaff087b09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebe2d8d-fc4d-429e-9741-f43a832a9e63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e6266-4fc0-4deb-bc13-05224fba097e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:10:23 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a96f762-4437-427e-9c36-c6e19e27830d]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG os_brick.utils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating existing volume attachment record: be0c550c-3583-4278-b2ff-0c4e97962869 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.network.neutron [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Successfully updated port: 5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquired lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.network.neutron [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-45f1cd11-aec7-498d-9506-dece41f2f168 req-7805322a-5084-4109-a1f8-ed6f2d13bbfa service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-changed-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-45f1cd11-aec7-498d-9506-dece41f2f168 req-7805322a-5084-4109-a1f8-ed6f2d13bbfa service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Refreshing instance network info cache due to event network-changed-5ed694ee-58b8-47e6-ad9e-1e1235b94f86. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-45f1cd11-aec7-498d-9506-dece41f2f168 req-7805322a-5084-4109-a1f8-ed6f2d13bbfa service nova] Acquiring lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.network.neutron [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.network.neutron [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Updating instance_info_cache with network_info: [{"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Releasing lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance network_info: |[{"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-45f1cd11-aec7-498d-9506-dece41f2f168 req-7805322a-5084-4109-a1f8-ed6f2d13bbfa service nova] Acquired lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.network.neutron [req-45f1cd11-aec7-498d-9506-dece41f2f168 req-7805322a-5084-4109-a1f8-ed6f2d13bbfa service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Refreshing network info cache for port 5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Start _get_guest_xml network_info=[{"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:10:23 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:10:23 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-261110518',display_name='tempest-tempest.common.compute-instance-261110518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-261110518',id=12,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NfBFLqJtGbvXoityJVqzPb6+0NitNd540fExHmEMlMS7yAqjRzdOfdBee660sbMv3MotVe+QM6Z8SS0UbFUtsNWJuxD1BFJ1pShsGKYPAFQnGdZtf5H8KIZhfj6YNeQ==',key_name='tempest-keypair-1107223125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-uf33iujx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=7e4b82ae-cdb8-45af-b0ef-350096e7ec3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.objects.instance [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:10:23 user nova-compute[73208]:   <uuid>7e4b82ae-cdb8-45af-b0ef-350096e7ec3e</uuid>
Aug 16 09:10:23 user nova-compute[73208]:   <name>instance-0000000c</name>
Aug 16 09:10:23 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:10:23 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:10:23 user nova-compute[73208]:   <metadata>
Aug 16 09:10:23 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:10:23 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:10:23 user nova-compute[73208]:       <nova:name>tempest-tempest.common.compute-instance-261110518</nova:name>
Aug 16 09:10:23 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:10:23</nova:creationTime>
Aug 16 09:10:23 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:10:23 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:10:23 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:10:23 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:10:23 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:10:23 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:10:23 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:10:23 user nova-compute[73208]:       <nova:owner>
Aug 16 09:10:23 user nova-compute[73208]:         <nova:user uuid="e351e35970aa48028ad400bbda5403b1">tempest-ServerActionsTestOtherA-1386845270-project-member</nova:user>
Aug 16 09:10:23 user nova-compute[73208]:         <nova:project uuid="d62017e5fe324a528f4ad1dc5c939498">tempest-ServerActionsTestOtherA-1386845270</nova:project>
Aug 16 09:10:23 user nova-compute[73208]:       </nova:owner>
Aug 16 09:10:23 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:10:23 user nova-compute[73208]:       <nova:ports>
Aug 16 09:10:23 user nova-compute[73208]:         <nova:port uuid="5ed694ee-58b8-47e6-ad9e-1e1235b94f86">
Aug 16 09:10:23 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 09:10:23 user nova-compute[73208]:         </nova:port>
Aug 16 09:10:23 user nova-compute[73208]:       </nova:ports>
Aug 16 09:10:23 user nova-compute[73208]:     </nova:instance>
Aug 16 09:10:23 user nova-compute[73208]:   </metadata>
Aug 16 09:10:23 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:10:23 user nova-compute[73208]:     <system>
Aug 16 09:10:23 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:10:23 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:10:23 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:10:23 user nova-compute[73208]:       <entry name="serial">7e4b82ae-cdb8-45af-b0ef-350096e7ec3e</entry>
Aug 16 09:10:23 user nova-compute[73208]:       <entry name="uuid">7e4b82ae-cdb8-45af-b0ef-350096e7ec3e</entry>
Aug 16 09:10:23 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:10:23 user nova-compute[73208]:     </system>
Aug 16 09:10:23 user nova-compute[73208]:   </sysinfo>
Aug 16 09:10:23 user nova-compute[73208]:   <os>
Aug 16 09:10:23 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:10:23 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:10:23 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:10:23 user nova-compute[73208]:   </os>
Aug 16 09:10:23 user nova-compute[73208]:   <features>
Aug 16 09:10:23 user nova-compute[73208]:     <acpi/>
Aug 16 09:10:23 user nova-compute[73208]:     <apic/>
Aug 16 09:10:23 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:10:23 user nova-compute[73208]:   </features>
Aug 16 09:10:23 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:10:23 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:10:23 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:10:23 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:10:23 user nova-compute[73208]:   </clock>
Aug 16 09:10:23 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:10:23 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:10:23 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:10:23 user nova-compute[73208]:   </cpu>
Aug 16 09:10:23 user nova-compute[73208]:   <devices>
Aug 16 09:10:23 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:10:23 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:10:23 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk"/>
Aug 16 09:10:23 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:10:23 user nova-compute[73208]:     </disk>
Aug 16 09:10:23 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:10:23 user nova-compute[73208]:       <mac address="fa:16:3e:ae:42:5f"/>
Aug 16 09:10:23 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:10:23 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:10:23 user nova-compute[73208]:       <target dev="tap5ed694ee-58"/>
Aug 16 09:10:23 user nova-compute[73208]:     </interface>
Aug 16 09:10:23 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:10:23 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/console.log" append="off"/>
Aug 16 09:10:23 user nova-compute[73208]:     </serial>
Aug 16 09:10:23 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:10:23 user nova-compute[73208]:     <video>
Aug 16 09:10:23 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:10:23 user nova-compute[73208]:     </video>
Aug 16 09:10:23 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:10:23 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:10:23 user nova-compute[73208]:     </rng>
Aug 16 09:10:23 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:10:23 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:10:23 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:10:23 user nova-compute[73208]:     </memballoon>
Aug 16 09:10:23 user nova-compute[73208]:   </devices>
Aug 16 09:10:23 user nova-compute[73208]: </domain>
Aug 16 09:10:23 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-261110518',display_name='tempest-tempest.common.compute-instance-261110518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-261110518',id=12,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NfBFLqJtGbvXoityJVqzPb6+0NitNd540fExHmEMlMS7yAqjRzdOfdBee660sbMv3MotVe+QM6Z8SS0UbFUtsNWJuxD1BFJ1pShsGKYPAFQnGdZtf5H8KIZhfj6YNeQ==',key_name='tempest-keypair-1107223125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-uf33iujx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=7e4b82ae-cdb8-45af-b0ef-350096e7ec3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG os_vif [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ed694ee-58, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ed694ee-58, col_values=(('external_ids', {'iface-id': '5ed694ee-58b8-47e6-ad9e-1e1235b94f86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:42:5f', 'vm-uuid': '7e4b82ae-cdb8-45af-b0ef-350096e7ec3e'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:24 user nova-compute[73208]: INFO os_vif [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58')
Aug 16 09:10:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No VIF found with MAC fa:16:3e:ae:42:5f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG nova.network.neutron [req-45f1cd11-aec7-498d-9506-dece41f2f168 req-7805322a-5084-4109-a1f8-ed6f2d13bbfa service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Updated VIF entry in instance network info cache for port 5ed694ee-58b8-47e6-ad9e-1e1235b94f86. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG nova.network.neutron [req-45f1cd11-aec7-498d-9506-dece41f2f168 req-7805322a-5084-4109-a1f8-ed6f2d13bbfa service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Updating instance_info_cache with network_info: [{"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-45f1cd11-aec7-498d-9506-dece41f2f168 req-7805322a-5084-4109-a1f8-ed6f2d13bbfa service nova] Releasing lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG nova.objects.instance [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'flavor' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:25 user nova-compute[73208]: INFO nova.compute.manager [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Attaching volume 9a7dc374-5cdb-4b8c-a439-828bd4f0c44c to /dev/vdb
Aug 16 09:10:25 user nova-compute[73208]: DEBUG os_brick.utils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6682443b-b11b-4859-8bfe-4cd125d56526]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ce87cb-9cd9-418b-a309-284ff577d9b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ecc02d-1af4-4989-a334-aeaa5bb6b464]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[818522b6-80ba-4454-b08e-c9fabd36ce83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:10:25 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:10:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7176aed4-03c3-46a0-9dd2-ec070069da0e]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG os_brick.utils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:10:25 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating existing volume attachment record: fcb6b91a-e164-4caa-8ce5-7f34bd7c87a4 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:10:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-e8e3a78f-9df3-4355-b34e-e9bd8f749b51 req-f11ec4b3-b803-4a09-a5e5-632782ed4a4b service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e8e3a78f-9df3-4355-b34e-e9bd8f749b51 req-f11ec4b3-b803-4a09-a5e5-632782ed4a4b service nova] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e8e3a78f-9df3-4355-b34e-e9bd8f749b51 req-f11ec4b3-b803-4a09-a5e5-632782ed4a4b service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e8e3a78f-9df3-4355-b34e-e9bd8f749b51 req-f11ec4b3-b803-4a09-a5e5-632782ed4a4b service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-e8e3a78f-9df3-4355-b34e-e9bd8f749b51 req-f11ec4b3-b803-4a09-a5e5-632782ed4a4b service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] No waiting events found dispatching network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:26 user nova-compute[73208]: WARNING nova.compute.manager [req-e8e3a78f-9df3-4355-b34e-e9bd8f749b51 req-f11ec4b3-b803-4a09-a5e5-632782ed4a4b service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received unexpected event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 for instance with vm_state building and task_state spawning.
Aug 16 09:10:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:27 user nova-compute[73208]: INFO nova.compute.manager [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Terminating instance
Aug 16 09:10:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-c61fac94-e811-43a5-b4bb-7689b04e844c req-5ddd93da-17ab-434f-ba58-2ea51d100346 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-unplugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c61fac94-e811-43a5-b4bb-7689b04e844c req-5ddd93da-17ab-434f-ba58-2ea51d100346 service nova] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c61fac94-e811-43a5-b4bb-7689b04e844c req-5ddd93da-17ab-434f-ba58-2ea51d100346 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c61fac94-e811-43a5-b4bb-7689b04e844c req-5ddd93da-17ab-434f-ba58-2ea51d100346 service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-c61fac94-e811-43a5-b4bb-7689b04e844c req-5ddd93da-17ab-434f-ba58-2ea51d100346 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] No waiting events found dispatching network-vif-unplugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-c61fac94-e811-43a5-b4bb-7689b04e844c req-5ddd93da-17ab-434f-ba58-2ea51d100346 service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-unplugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177028.0339088, 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] VM Resumed (Lifecycle Event)
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance spawned successfully.
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177028.037049, 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] VM Started (Lifecycle Event)
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-6f9518fe-34a3-454e-894c-203f75032854 req-d96831ab-7bc0-44b7-b32e-19d975213840 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6f9518fe-34a3-454e-894c-203f75032854 req-d96831ab-7bc0-44b7-b32e-19d975213840 service nova] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6f9518fe-34a3-454e-894c-203f75032854 req-d96831ab-7bc0-44b7-b32e-19d975213840 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6f9518fe-34a3-454e-894c-203f75032854 req-d96831ab-7bc0-44b7-b32e-19d975213840 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-6f9518fe-34a3-454e-894c-203f75032854 req-d96831ab-7bc0-44b7-b32e-19d975213840 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] No waiting events found dispatching network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:28 user nova-compute[73208]: WARNING nova.compute.manager [req-6f9518fe-34a3-454e-894c-203f75032854 req-d96831ab-7bc0-44b7-b32e-19d975213840 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received unexpected event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 for instance with vm_state building and task_state spawning.
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Took 7.20 seconds to spawn the instance on the hypervisor.
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Instance destroyed successfully.
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lazy-loading 'resources' on Instance uuid 341d90a7-086a-42ce-9c23-d3422883d13e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-618417393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-618417393',id=7,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ktSyMNqN+//oYSOVbrxLW7mJdmZHC5ptBlsOujkgTZW9UidySyKnsJ1hhc7SzuHeqgpDES3y2LrkfSsR7Gs2OhPrzOxAV2HVMpaarMa4gvhwj0y6l32EpyQ4DsrEylA==',key_name='tempest-keypair-1546494890',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='293a0d6bce9943868579b6b88a526f2b',ramdisk_id='',reservation_id='r-e7k78y5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2091015158',owner_user_name='tempest-TaggedAttachmentsTest-2091015158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47c19f8b4a714169ba98d35d751dafd7',uuid=341d90a7-086a-42ce-9c23-d3422883d13e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converting VIF {"id": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "address": "fa:16:3e:c2:f8:7f", "network": {"id": "3615971c-83be-448d-8c2e-d333a6e6f9f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-95862708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293a0d6bce9943868579b6b88a526f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a387ca-2e", "ovs_interfaceid": "19a387ca-2e14-4170-947a-5f2b5f1f9bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=19a387ca-2e14-4170-947a-5f2b5f1f9bf1,network=Network(3615971c-83be-448d-8c2e-d333a6e6f9f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a387ca-2e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG os_vif [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=19a387ca-2e14-4170-947a-5f2b5f1f9bf1,network=Network(3615971c-83be-448d-8c2e-d333a6e6f9f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a387ca-2e') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19a387ca-2e, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:28 user nova-compute[73208]: INFO os_vif [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=19a387ca-2e14-4170-947a-5f2b5f1f9bf1,network=Network(3615971c-83be-448d-8c2e-d333a6e6f9f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a387ca-2e')
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Deleting instance files /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e_del
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Deletion of /opt/stack/data/nova/instances/341d90a7-086a-42ce-9c23-d3422883d13e_del complete
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.compute.manager [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Took 8.08 seconds to build instance.
Aug 16 09:10:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90164fc9-5b5e-43c3-9883-70f40dd01620 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.184s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:28 user nova-compute[73208]: INFO nova.compute.manager [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 16 09:10:28 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:10:28 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:10:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-a93961fb-2f1e-4f6b-b84d-ec8d5ed5818e req-ea97c2f6-d238-4919-8c64-b47eb09854ba service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a93961fb-2f1e-4f6b-b84d-ec8d5ed5818e req-ea97c2f6-d238-4919-8c64-b47eb09854ba service nova] Acquiring lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a93961fb-2f1e-4f6b-b84d-ec8d5ed5818e req-ea97c2f6-d238-4919-8c64-b47eb09854ba service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a93961fb-2f1e-4f6b-b84d-ec8d5ed5818e req-ea97c2f6-d238-4919-8c64-b47eb09854ba service nova] Lock "341d90a7-086a-42ce-9c23-d3422883d13e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-a93961fb-2f1e-4f6b-b84d-ec8d5ed5818e req-ea97c2f6-d238-4919-8c64-b47eb09854ba service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] No waiting events found dispatching network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:30 user nova-compute[73208]: WARNING nova.compute.manager [req-a93961fb-2f1e-4f6b-b84d-ec8d5ed5818e req-ea97c2f6-d238-4919-8c64-b47eb09854ba service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received unexpected event network-vif-plugged-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 for instance with vm_state active and task_state deleting.
Aug 16 09:10:30 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:30 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Took 2.12 seconds to deallocate network for instance.
Aug 16 09:10:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-59e39922-49d8-4188-8eed-b546493a0ddd req-2638538a-c51c-4d87-a3b6-08f38fdf44ba service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Received event network-vif-deleted-19a387ca-2e14-4170-947a-5f2b5f1f9bf1 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:30 user nova-compute[73208]: INFO nova.compute.manager [req-59e39922-49d8-4188-8eed-b546493a0ddd req-2638538a-c51c-4d87-a3b6-08f38fdf44ba service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Neutron deleted interface 19a387ca-2e14-4170-947a-5f2b5f1f9bf1; detaching it from the instance and deleting it from the info cache
Aug 16 09:10:30 user nova-compute[73208]: DEBUG nova.network.neutron [req-59e39922-49d8-4188-8eed-b546493a0ddd req-2638538a-c51c-4d87-a3b6-08f38fdf44ba service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-59e39922-49d8-4188-8eed-b546493a0ddd req-2638538a-c51c-4d87-a3b6-08f38fdf44ba service nova] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Detach interface failed, port_id=19a387ca-2e14-4170-947a-5f2b5f1f9bf1, reason: Instance 341d90a7-086a-42ce-9c23-d3422883d13e could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:10:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:31 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:10:31 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:10:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:31 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Deleted allocations for instance 341d90a7-086a-42ce-9c23-d3422883d13e
Aug 16 09:10:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-82898826-0f4e-41de-ba0f-c54b246e46a9 tempest-TaggedAttachmentsTest-2091015158 tempest-TaggedAttachmentsTest-2091015158-project-member] Lock "341d90a7-086a-42ce-9c23-d3422883d13e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.831s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:34 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177019.2799134, 77d077df-579d-4d9d-b76b-14d5d0a0d26f => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:10:34 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] VM Stopped (Lifecycle Event)
Aug 16 09:10:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e874b671-fe3b-4947-999b-2ba6dbbdec05 None None] [instance: 77d077df-579d-4d9d-b76b-14d5d0a0d26f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:35 user nova-compute[73208]: DEBUG nova.objects.instance [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'pci_requests' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:35 user nova-compute[73208]: DEBUG nova.objects.instance [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:10:35 user nova-compute[73208]: INFO nova.compute.claims [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Claim successful on node user
Aug 16 09:10:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:10:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:10:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:35 user nova-compute[73208]: INFO nova.network.neutron [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating port 0bbaa277-2952-499a-9b56-e0dc09d81095 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquired lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-9ae39265-1805-4cdb-9404-4b6e0379cce6 req-48486400-0abd-4bbe-9291-4b0dfd3083ce service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-changed-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-9ae39265-1805-4cdb-9404-4b6e0379cce6 req-48486400-0abd-4bbe-9291-4b0dfd3083ce service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Refreshing instance network info cache due to event network-changed-0bbaa277-2952-499a-9b56-e0dc09d81095. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9ae39265-1805-4cdb-9404-4b6e0379cce6 req-48486400-0abd-4bbe-9291-4b0dfd3083ce service nova] Acquiring lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Releasing lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:10:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Creating image(s)
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9ae39265-1805-4cdb-9404-4b6e0379cce6 req-48486400-0abd-4bbe-9291-4b0dfd3083ce service nova] Acquired lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG nova.network.neutron [req-9ae39265-1805-4cdb-9404-4b6e0379cce6 req-48486400-0abd-4bbe-9291-4b0dfd3083ce service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Refreshing network info cache for port 0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:10:39 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:10:39 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:10:39 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[525716a0-3972-47b1-b5ae-b2a94ab8bf4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:10:39 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c354dbdc-e3fe-4530-9848-f725ea20112f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c] added
Aug 16 09:10:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f32103-a500-4a76-9def-8b6e6114189d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecc01e6-cbfd-4653-8e04-f85cf48f804b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOIMXevc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752.part --force-share --output=json" returned: 0 in 0.229s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG nova.virt.images [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] a359a36c-319c-4d82-8dba-165429d8b00f was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752.part /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOIMXevc" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5835f17d-b8f3-41c6-a0f4-188c445df291]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zOIMXevc'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd4c46a-e019-475b-b77f-788a77733718]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f59937-4af4-424c-91c5-23cc5bf9a1e6]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd22203-51cf-4756-99df-158150db1a1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]
Aug 16 09:10:39 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.
Aug 16 09:10:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f232ae-b5ee-424d-9812-1549df1f0544]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4004bbda-a11c-44c6-b671-2bfcc2e0d176]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:10:39 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:10:39 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752.part /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752.converted" returned: 0 in 0.271s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e432a19b-d683-42c0-9880-99463e376e1d]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752.converted --force-share --output=json" returned: 0 in 0.235s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.040s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752 --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-9ae39265-1805-4cdb-9404-4b6e0379cce6 req-48486400-0abd-4bbe-9291-4b0dfd3083ce service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updated VIF entry in instance network info cache for port 0bbaa277-2952-499a-9b56-e0dc09d81095. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-9ae39265-1805-4cdb-9404-4b6e0379cce6 req-48486400-0abd-4bbe-9291-4b0dfd3083ce service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9ae39265-1805-4cdb-9404-4b6e0379cce6 req-48486400-0abd-4bbe-9291-4b0dfd3083ce service nova] Releasing lock "refresh_cache-8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752 --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752,backing_fmt=raw /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752,backing_fmt=raw /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk 1073741824" returned: 0 in 0.064s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752 --force-share --output=json" returned: 0 in 0.212s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG nova.objects.instance [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'migration_context' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:40 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Rebasing disk image.
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.516s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== connect_volume: return (1520ms) {'type': 'block', 'scsi_wwn': '26337663336363830', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337663336363830', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG nova.objects.instance [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'flavor' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:10:40 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:10:40 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:10:40 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:10:40 user nova-compute[73208]:   <serial>9a7dc374-5cdb-4b8c-a439-828bd4f0c44c</serial>
Aug 16 09:10:40 user nova-compute[73208]: </disk>
Aug 16 09:10:40 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.216s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 -F raw /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:10:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:10:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] No VIF found with MAC fa:16:3e:e0:7b:07, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:10:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-95fe585d-e450-4401-b9fc-6b0a4a644e77 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.807s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 -F raw /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk" returned: 0 in 2.526s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Ensure instance console log exists: /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Start _get_guest_xml network_info=[{"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e32db5ead511d6bc8244ee66d5c6229a',container_format='bare',created_at=2023-08-16T09:08:30Z,direct_url=<?>,disk_format='qcow2',id=a359a36c-319c-4d82-8dba-165429d8b00f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-86453005-shelved',owner='05e96874fcad4d3b8fcd66f3f513b13d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T09:08:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': 'be0c550c-3583-4278-b2ff-0c4e97962869', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVvtcQSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8b78d27e-d22f-45a7-8fd4-0d0366fd68ad', 'attached_at': '', 'detached_at': '', 'volume_id': 'f67a4b7d-0350-4190-bc4a-a8e66fcea658', 'serial': 'f67a4b7d-0350-4190-bc4a-a8e66fcea658'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:10:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:10:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177028.3729892, 341d90a7-086a-42ce-9c23-d3422883d13e => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:10:43 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] VM Stopped (Lifecycle Event)
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e32db5ead511d6bc8244ee66d5c6229a',container_format='bare',created_at=2023-08-16T09:08:30Z,direct_url=<?>,disk_format='qcow2',id=a359a36c-319c-4d82-8dba-165429d8b00f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-86453005-shelved',owner='05e96874fcad4d3b8fcd66f3f513b13d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T09:08:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4d4b9081-8293-40d2-a4cf-041fef07ca7d None None] [instance: 341d90a7-086a-42ce-9c23-d3422883d13e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVvtcQSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:10:43 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:10:43 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:10:43 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b16d56-c8ba-441e-a38d-af80066a650d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:10:43 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00c2bf-f30f-4863-bcd0-dc8b88240c03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658] added
Aug 16 09:10:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae3ceef-e8fa-41e9-94e6-f4cd5754b37c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7ad114-591a-48ec-b1de-8a44dc881510]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVvtcQSK {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVvtcQSK" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1501fd1d-b14c-47f5-a104-44a077aae74c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVvtcQSK'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8abe42-3c5c-4500-9f44-c222e1cc20c7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f51ac9-69b0-4b1e-a387-75c9f57f4126]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:10:43 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:10:43 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b2cd74-068e-4211-8840-956e6b6c12b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658, portal: 172.16.0.220,3260]
Aug 16 09:10:43 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658, portal: 172.16.0.220,3260] successful.
Aug 16 09:10:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76ee8e-a648-402e-80a1-6f44aa0afe61]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc83db5-28ae-43ff-af08-a6a924b8351e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:10:43 user nova-compute[73208]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:10:43 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:10:43 user nova-compute[73208]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:10:43 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:43 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac708c2d-ae28-4bd9-8b62-ee69695ec585]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:10:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVvtcQSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Stashing vm_state: active {{(pid=73208) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'pci_requests' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:10:44 user nova-compute[73208]: INFO nova.compute.claims [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Claim successful on node user
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'resources' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'pci_devices' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:44 user nova-compute[73208]: INFO nova.compute.resource_tracker [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating resource usage from migration f70695c7-f599-43fa-a3f6-f5ae22102d99
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.337s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:44 user nova-compute[73208]: INFO nova.compute.manager [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Migrating
Aug 16 09:10:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:44 user nova-compute[73208]: INFO nova.compute.rpcapi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 09:10:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26334343835653936', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334343835653936', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-86453005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-86453005',id=2,image_ref='a359a36c-319c-4d82-8dba-165429d8b00f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1433315580',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-22bku0a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member',shelved_at='2023-08-16T09:08:34.723538',shelved_host='user',shelved_image_id='a359a36c-319c-4d82-8dba-165429d8b00f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b78d27e-d22f-45a7-8fd4-0d0366fd68ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:10:44 user nova-compute[73208]:   <uuid>8b78d27e-d22f-45a7-8fd4-0d0366fd68ad</uuid>
Aug 16 09:10:44 user nova-compute[73208]:   <name>instance-00000002</name>
Aug 16 09:10:44 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:10:44 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:10:44 user nova-compute[73208]:   <metadata>
Aug 16 09:10:44 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:10:44 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:10:44 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-86453005</nova:name>
Aug 16 09:10:44 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:10:43</nova:creationTime>
Aug 16 09:10:44 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:10:44 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:10:44 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:10:44 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:10:44 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:10:44 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:10:44 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:10:44 user nova-compute[73208]:       <nova:owner>
Aug 16 09:10:44 user nova-compute[73208]:         <nova:user uuid="858c944850cd4fe69b6c8f782cae394a">tempest-AttachVolumeShelveTestJSON-1142897180-project-member</nova:user>
Aug 16 09:10:44 user nova-compute[73208]:         <nova:project uuid="05e96874fcad4d3b8fcd66f3f513b13d">tempest-AttachVolumeShelveTestJSON-1142897180</nova:project>
Aug 16 09:10:44 user nova-compute[73208]:       </nova:owner>
Aug 16 09:10:44 user nova-compute[73208]:       <nova:root type="image" uuid="a359a36c-319c-4d82-8dba-165429d8b00f"/>
Aug 16 09:10:44 user nova-compute[73208]:       <nova:ports>
Aug 16 09:10:44 user nova-compute[73208]:         <nova:port uuid="0bbaa277-2952-499a-9b56-e0dc09d81095">
Aug 16 09:10:44 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 09:10:44 user nova-compute[73208]:         </nova:port>
Aug 16 09:10:44 user nova-compute[73208]:       </nova:ports>
Aug 16 09:10:44 user nova-compute[73208]:     </nova:instance>
Aug 16 09:10:44 user nova-compute[73208]:   </metadata>
Aug 16 09:10:44 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:10:44 user nova-compute[73208]:     <system>
Aug 16 09:10:44 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:10:44 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:10:44 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:10:44 user nova-compute[73208]:       <entry name="serial">8b78d27e-d22f-45a7-8fd4-0d0366fd68ad</entry>
Aug 16 09:10:44 user nova-compute[73208]:       <entry name="uuid">8b78d27e-d22f-45a7-8fd4-0d0366fd68ad</entry>
Aug 16 09:10:44 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:10:44 user nova-compute[73208]:     </system>
Aug 16 09:10:44 user nova-compute[73208]:   </sysinfo>
Aug 16 09:10:44 user nova-compute[73208]:   <os>
Aug 16 09:10:44 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:10:44 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:10:44 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:10:44 user nova-compute[73208]:   </os>
Aug 16 09:10:44 user nova-compute[73208]:   <features>
Aug 16 09:10:44 user nova-compute[73208]:     <acpi/>
Aug 16 09:10:44 user nova-compute[73208]:     <apic/>
Aug 16 09:10:44 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:10:44 user nova-compute[73208]:   </features>
Aug 16 09:10:44 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:10:44 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:10:44 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:10:44 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:10:44 user nova-compute[73208]:   </clock>
Aug 16 09:10:44 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:10:44 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:10:44 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:10:44 user nova-compute[73208]:   </cpu>
Aug 16 09:10:44 user nova-compute[73208]:   <devices>
Aug 16 09:10:44 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:10:44 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:10:44 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk"/>
Aug 16 09:10:44 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:10:44 user nova-compute[73208]:     </disk>
Aug 16 09:10:44 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:10:44 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:10:44 user nova-compute[73208]:       <source dev="/dev/sdc"/>
Aug 16 09:10:44 user nova-compute[73208]:       <target dev="vdc" bus="virtio"/>
Aug 16 09:10:44 user nova-compute[73208]:       <serial>f67a4b7d-0350-4190-bc4a-a8e66fcea658</serial>
Aug 16 09:10:44 user nova-compute[73208]:     </disk>
Aug 16 09:10:44 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:10:44 user nova-compute[73208]:       <mac address="fa:16:3e:8d:02:a6"/>
Aug 16 09:10:44 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:10:44 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:10:44 user nova-compute[73208]:       <target dev="tap0bbaa277-29"/>
Aug 16 09:10:44 user nova-compute[73208]:     </interface>
Aug 16 09:10:44 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:10:44 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/console.log" append="off"/>
Aug 16 09:10:44 user nova-compute[73208]:     </serial>
Aug 16 09:10:44 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:10:44 user nova-compute[73208]:     <video>
Aug 16 09:10:44 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:10:44 user nova-compute[73208]:     </video>
Aug 16 09:10:44 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:10:44 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:10:44 user nova-compute[73208]:     </rng>
Aug 16 09:10:44 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:10:44 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:10:44 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:10:44 user nova-compute[73208]:     </memballoon>
Aug 16 09:10:44 user nova-compute[73208]:   </devices>
Aug 16 09:10:44 user nova-compute[73208]: </domain>
Aug 16 09:10:44 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-86453005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-86453005',id=2,image_ref='a359a36c-319c-4d82-8dba-165429d8b00f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1433315580',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-22bku0a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member',shelved_at='2023-08-16T09:08:34.723538',shelved_host='user',shelved_image_id='a359a36c-319c-4d82-8dba-165429d8b00f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b78d27e-d22f-45a7-8fd4-0d0366fd68ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG os_vif [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bbaa277-29, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bbaa277-29, col_values=(('external_ids', {'iface-id': '0bbaa277-2952-499a-9b56-e0dc09d81095', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:02:a6', 'vm-uuid': '8b78d27e-d22f-45a7-8fd4-0d0366fd68ad'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:44 user nova-compute[73208]: INFO os_vif [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29')
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:10:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No VIF found with MAC fa:16:3e:8d:02:a6, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Starting migrate_disk_and_power_off {{(pid=73208) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8bfc59c-b971-42ad-b575-49c278ae4eab req-024d5565-e79c-41f2-b86c-b02eeaaaded5 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d8bfc59c-b971-42ad-b575-49c278ae4eab req-024d5565-e79c-41f2-b86c-b02eeaaaded5 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d8bfc59c-b971-42ad-b575-49c278ae4eab req-024d5565-e79c-41f2-b86c-b02eeaaaded5 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d8bfc59c-b971-42ad-b575-49c278ae4eab req-024d5565-e79c-41f2-b86c-b02eeaaaded5 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8bfc59c-b971-42ad-b575-49c278ae4eab req-024d5565-e79c-41f2-b86c-b02eeaaaded5 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:45 user nova-compute[73208]: WARNING nova.compute.manager [req-d8bfc59c-b971-42ad-b575-49c278ae4eab req-024d5565-e79c-41f2-b86c-b02eeaaaded5 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state resize_migrating.
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance destroyed successfully.
Aug 16 09:10:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:10:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1879811333-network", "vif_mac": "fa:16:3e:e0:7b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1879811333-network", "vif_mac": "fa:16:3e:e0:7b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_vif [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b934682-5a, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:46 user nova-compute[73208]: INFO os_vif [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a')
Aug 16 09:10:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:10:46 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a03231b-ce58-4d0e-a6bf-f56a239a6044]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce52a28-4ebd-4fea-8706-17f7b7129d94]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:10:46 user nova-compute[73208]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:10:46 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:46 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:10:46 user nova-compute[73208]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:10:46 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:10:46 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0244430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e06ced8-1663-4d4f-bd5a-0d4ae79c5f39]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2a6f73-346b-4c3c-91c4-890e461667d3]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:10:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ebaf8-a2cf-41cc-9cc2-fd289ed1fadf]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-fa3344c7-163f-4559-87ff-3d7800fcbc8c req-c5916afb-817d-48ca-b848-ca79f67b9611 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa3344c7-163f-4559-87ff-3d7800fcbc8c req-c5916afb-817d-48ca-b848-ca79f67b9611 service nova] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa3344c7-163f-4559-87ff-3d7800fcbc8c req-c5916afb-817d-48ca-b848-ca79f67b9611 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa3344c7-163f-4559-87ff-3d7800fcbc8c req-c5916afb-817d-48ca-b848-ca79f67b9611 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-fa3344c7-163f-4559-87ff-3d7800fcbc8c req-c5916afb-817d-48ca-b848-ca79f67b9611 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] No waiting events found dispatching network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:47 user nova-compute[73208]: WARNING nova.compute.manager [req-fa3344c7-163f-4559-87ff-3d7800fcbc8c req-c5916afb-817d-48ca-b848-ca79f67b9611 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received unexpected event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23f1417-7857-4435-a736-71cbc8e36be6]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5d97d-354d-498b-9a5f-26561ba99ea7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b62217-2a4e-4331-a33e-6f50865d9017]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]
Aug 16 09:10:47 user nova-compute[73208]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.
Aug 16 09:10:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d71036-0656-4e44-aef0-297e8ac9419b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== disconnect_volume: return (349ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432_resize/disk /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:47 user nova-compute[73208]: WARNING nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state resize_migrating.
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:47 user nova-compute[73208]: WARNING nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state resize_migrating.
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:47 user nova-compute[73208]: WARNING nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state resize_migrating.
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:47 user nova-compute[73208]: WARNING nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state resize_migrating.
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:47 user nova-compute[73208]: WARNING nova.compute.manager [req-19b8fe63-ac4e-4f16-b876-e8cc66c71ed7 req-1f05730f-7de9-46f9-a607-2f3172901e84 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state resize_migrating.
Aug 16 09:10:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "cp -r /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432_resize/disk /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk" returned: 0 in 0.373s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432_resize/disk.info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk.info {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "cp -r /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432_resize/disk.info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk.info" returned: 0 in 0.054s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-bae0ee0f-8047-42f2-8c1b-4e8d58e56982 req-13a4cf46-9e3c-4275-849c-58da67d2cdb8 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bae0ee0f-8047-42f2-8c1b-4e8d58e56982 req-13a4cf46-9e3c-4275-849c-58da67d2cdb8 service nova] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bae0ee0f-8047-42f2-8c1b-4e8d58e56982 req-13a4cf46-9e3c-4275-849c-58da67d2cdb8 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bae0ee0f-8047-42f2-8c1b-4e8d58e56982 req-13a4cf46-9e3c-4275-849c-58da67d2cdb8 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-bae0ee0f-8047-42f2-8c1b-4e8d58e56982 req-13a4cf46-9e3c-4275-849c-58da67d2cdb8 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] No waiting events found dispatching network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:10:49 user nova-compute[73208]: WARNING nova.compute.manager [req-bae0ee0f-8047-42f2-8c1b-4e8d58e56982 req-13a4cf46-9e3c-4275-849c-58da67d2cdb8 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received unexpected event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177049.1743178, 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:10:49 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] VM Resumed (Lifecycle Event)
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:10:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance spawned successfully.
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:10:49 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177049.177269, 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:10:49 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] VM Started (Lifecycle Event)
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:10:49 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Port 9b934682-5a56-428d-8362-8cb499a85a94 binding to destination host user is already ACTIVE {{(pid=73208) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fabf3905-22e3-4a41-977b-bd293235c7e5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.888s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG os_brick.utils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d82fed-1030-4ce0-b0af-bf04c5fd42f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4aad9-a018-4913-bc89-5efe33ad9dab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b84c44-1beb-4278-9983-690b9d4755cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8798d150-8308-46c1-a691-24a0f1dc1725]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:10:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:10:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:10:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:10:51 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:10:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d715a1f1-3f52-49f0-bc2e-4559b4963873]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:10:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:10:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:10:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:10:51 user nova-compute[73208]: DEBUG os_brick.utils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:10:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:58 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:10:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquired lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:10:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:10:58 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'info_cache' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating instance_info_cache with network_info: [{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Releasing lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:10:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance destroyed successfully.
Aug 16 09:10:59 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'resources' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG os_vif [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap898d4cd1-4f, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:10:59 user nova-compute[73208]: INFO os_vif [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f')
Aug 16 09:10:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Iifrawxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:10:59 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:10:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:10:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce9f2d1-3f06-4596-928c-034a6299a7a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaf41b5-6ca5-45ce-8214-08ad1a67c5f8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f00f29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384'): ({'sdg'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Removing single pathed devices sdg {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a78633-f4e3-4c17-9aef-b22a0f5d046c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.033s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a707c5d-cb64-4015-957f-606febd804ef]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flushing IO for device /dev/sdg {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac840f-f9b4-498d-b11f-3ebf6a00b41b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[496a0126-04ce-4020-a9d4-b0b78e293d68]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] SCSI volumes sdg have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[039cf5d5-c55f-4a56-9130-f99ae375d29f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b1ba5e-c5eb-4a0d-95e0-36e3d73cbc70]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260]
Aug 16 09:11:00 user nova-compute[73208]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260] successful.
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b450d1-f77f-4292-ac21-efec5679f8c4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== disconnect_volume: return (365ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Start _get_guest_xml network_info=[{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'b96dd42f-a562-4cc9-8ebe-a7995ed5c5d3', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Iifrawxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '9fad0fe4-79f6-4023-8119-f076ba45cf4e', 'attached_at': '', 'detached_at': '', 'volume_id': '20d34247-87f5-4a67-a19f-15f07e34e384', 'serial': '20d34247-87f5-4a67-a19f-15f07e34e384'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'numa_topology' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:00 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:00 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Iifrawxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:11:00 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:11:00 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:11:00 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea33c116-c3f7-458c-a320-3d12f780ec79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:11:00 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[327c7ac2-d2e6-41fe-baef-548f0810f7f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384] added
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[478dcf01-fc7e-4773-ac37-473225ec3cb9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[821cd9db-5714-400c-a162-02f57fe1faa5]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Iifrawxd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Iifrawxd" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3322a051-268f-4a03-878d-1c3ac5ce952d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Iifrawxd'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5aa575-3521-48eb-8d46-01576ee9374f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c384b3-522d-489a-8416-cac4d66939cd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[25edb85f-0133-42e0-b404-066df08e05ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260]
Aug 16 09:11:00 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260] successful.
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01e1ad8-85af-43b1-b9e6-41389cde9cbd]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37223ae-7ffd-40f6-bc9f-5efb2bcf395a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:11:00 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2acf35-7df5-45ad-bf22-15f27387141c]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Iifrawxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:11:00 user nova-compute[73208]: INFO nova.compute.claims [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Claim successful on node user
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.network.neutron [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:11:01 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.policy [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a8d8e5f626c4fce850268849137e91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc4826a52774d7886beb8dd1f145ae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:11:01 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Creating image(s)
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "/opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "/opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "/opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177046.7672863, beb4ea79-b782-4540-8814-09b15002b432 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:01 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Stopped (Lifecycle Event)
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-61bfca80-1fb8-47f9-b767-482ecc62adea None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-61bfca80-1fb8-47f9-b767-482ecc62adea None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:01 user nova-compute[73208]: INFO nova.compute.manager [None req-61bfca80-1fb8-47f9-b767-482ecc62adea None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 09:11:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23937323262386635', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937323262386635', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.223s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:11:01 user nova-compute[73208]:   <uuid>9fad0fe4-79f6-4023-8119-f076ba45cf4e</uuid>
Aug 16 09:11:01 user nova-compute[73208]:   <name>instance-00000005</name>
Aug 16 09:11:01 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:11:01 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:11:01 user nova-compute[73208]:   <metadata>
Aug 16 09:11:01 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:11:01 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:11:01 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeTestJSON-server-1426683030</nova:name>
Aug 16 09:11:01 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:11:00</nova:creationTime>
Aug 16 09:11:01 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:11:01 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:11:01 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:11:01 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:11:01 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:11:01 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:11:01 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:11:01 user nova-compute[73208]:       <nova:owner>
Aug 16 09:11:01 user nova-compute[73208]:         <nova:user uuid="440128c7fc3046068e7020c70ffb25d9">tempest-AttachVolumeTestJSON-60014534-project-member</nova:user>
Aug 16 09:11:01 user nova-compute[73208]:         <nova:project uuid="9e4186d2c7f14b4ab3010a7302f5f1d3">tempest-AttachVolumeTestJSON-60014534</nova:project>
Aug 16 09:11:01 user nova-compute[73208]:       </nova:owner>
Aug 16 09:11:01 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:11:01 user nova-compute[73208]:       <nova:ports>
Aug 16 09:11:01 user nova-compute[73208]:         <nova:port uuid="898d4cd1-4f35-4e2c-b563-202493263a7b">
Aug 16 09:11:01 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 09:11:01 user nova-compute[73208]:         </nova:port>
Aug 16 09:11:01 user nova-compute[73208]:       </nova:ports>
Aug 16 09:11:01 user nova-compute[73208]:     </nova:instance>
Aug 16 09:11:01 user nova-compute[73208]:   </metadata>
Aug 16 09:11:01 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:11:01 user nova-compute[73208]:     <system>
Aug 16 09:11:01 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:11:01 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:11:01 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:11:01 user nova-compute[73208]:       <entry name="serial">9fad0fe4-79f6-4023-8119-f076ba45cf4e</entry>
Aug 16 09:11:01 user nova-compute[73208]:       <entry name="uuid">9fad0fe4-79f6-4023-8119-f076ba45cf4e</entry>
Aug 16 09:11:01 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:11:01 user nova-compute[73208]:     </system>
Aug 16 09:11:01 user nova-compute[73208]:   </sysinfo>
Aug 16 09:11:01 user nova-compute[73208]:   <os>
Aug 16 09:11:01 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:11:01 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:11:01 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:11:01 user nova-compute[73208]:   </os>
Aug 16 09:11:01 user nova-compute[73208]:   <features>
Aug 16 09:11:01 user nova-compute[73208]:     <acpi/>
Aug 16 09:11:01 user nova-compute[73208]:     <apic/>
Aug 16 09:11:01 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:11:01 user nova-compute[73208]:   </features>
Aug 16 09:11:01 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:11:01 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:11:01 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:11:01 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:11:01 user nova-compute[73208]:   </clock>
Aug 16 09:11:01 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:11:01 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:11:01 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:11:01 user nova-compute[73208]:   </cpu>
Aug 16 09:11:01 user nova-compute[73208]:   <devices>
Aug 16 09:11:01 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:11:01 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:11:01 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk"/>
Aug 16 09:11:01 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:11:01 user nova-compute[73208]:     </disk>
Aug 16 09:11:01 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:11:01 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:11:01 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:11:01 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:11:01 user nova-compute[73208]:       <serial>20d34247-87f5-4a67-a19f-15f07e34e384</serial>
Aug 16 09:11:01 user nova-compute[73208]:     </disk>
Aug 16 09:11:01 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:11:01 user nova-compute[73208]:       <mac address="fa:16:3e:28:fe:95"/>
Aug 16 09:11:01 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:01 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:11:01 user nova-compute[73208]:       <target dev="tap898d4cd1-4f"/>
Aug 16 09:11:01 user nova-compute[73208]:     </interface>
Aug 16 09:11:01 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:11:01 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/console.log" append="off"/>
Aug 16 09:11:01 user nova-compute[73208]:     </serial>
Aug 16 09:11:01 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:11:01 user nova-compute[73208]:     <video>
Aug 16 09:11:01 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:01 user nova-compute[73208]:     </video>
Aug 16 09:11:01 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:11:01 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:11:01 user nova-compute[73208]:     </rng>
Aug 16 09:11:01 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:11:01 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:11:01 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:11:01 user nova-compute[73208]:     </memballoon>
Aug 16 09:11:01 user nova-compute[73208]:   </devices>
Aug 16 09:11:01 user nova-compute[73208]: </domain>
Aug 16 09:11:01 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.205s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk 1073741824" returned: 0 in 0.055s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Successfully created port: 87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Cannot resize image /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.objects.instance [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lazy-loading 'migration_context' on Instance uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Ensure instance console log exists: /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Cannot resize image /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'migration_context' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG os_vif [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap898d4cd1-4f, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap898d4cd1-4f, col_values=(('external_ids', {'iface-id': '898d4cd1-4f35-4e2c-b563-202493263a7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:fe:95', 'vm-uuid': '9fad0fe4-79f6-4023-8119-f076ba45cf4e'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:11:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:02 user nova-compute[73208]: INFO os_vif [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f')
Aug 16 09:11:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Successfully updated port: 87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:11:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:11:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquired lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:11:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:11:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-fcd2703c-36bc-42d2-908e-4f74aaa2d204 req-145dd333-c43e-4a3b-8770-767308038bd4 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received event network-changed-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-fcd2703c-36bc-42d2-908e-4f74aaa2d204 req-145dd333-c43e-4a3b-8770-767308038bd4 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Refreshing instance network info cache due to event network-changed-87fdcd87-2939-41c6-9451-f9afe4d0f63a. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:11:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fcd2703c-36bc-42d2-908e-4f74aaa2d204 req-145dd333-c43e-4a3b-8770-767308038bd4 service nova] Acquiring lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:11:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Starting finish_migration {{(pid=73208) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance directory exists: not creating {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 09:11:04 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Creating image(s)
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.objects.instance [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'trusted_certs' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Updating instance_info_cache with network_info: [{"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Releasing lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Instance network_info: |[{"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fcd2703c-36bc-42d2-908e-4f74aaa2d204 req-145dd333-c43e-4a3b-8770-767308038bd4 service nova] Acquired lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-fcd2703c-36bc-42d2-908e-4f74aaa2d204 req-145dd333-c43e-4a3b-8770-767308038bd4 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Refreshing network info cache for port 87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Start _get_guest_xml network_info=[{"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:11:04 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:04 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1221957036',display_name='tempest-TestVolumeSwap-server-1221957036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1221957036',id=13,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfPN7e8Ra4v8TYV04lR36/auSxlLGZ7U8YKMQ8OBbkR4J0xvpr/rjmCUYxlrGrElb0+baayp6pOJvyTfGyQIwJkv+LoE7e/ThwY3u8h4i8JrnQr4Uf8lykDJy+MVLx5pg==',key_name='tempest-keypair-565264420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cc4826a52774d7886beb8dd1f145ae0',ramdisk_id='',reservation_id='r-nkqok5sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2048536046',owner_user_name='tempest-TestVolumeSwap-2048536046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a8d8e5f626c4fce850268849137e91a',uuid=650ba2c3-c61c-438b-8f87-79d5a98c078a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Converting VIF {"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=87fdcd87-2939-41c6-9451-f9afe4d0f63a,network=Network(a93cdfd8-98f5-450e-afba-c6ac70d4b657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcd87-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.objects.instance [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lazy-loading 'pci_devices' on Instance uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:11:04 user nova-compute[73208]:   <uuid>650ba2c3-c61c-438b-8f87-79d5a98c078a</uuid>
Aug 16 09:11:04 user nova-compute[73208]:   <name>instance-0000000d</name>
Aug 16 09:11:04 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:11:04 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:11:04 user nova-compute[73208]:   <metadata>
Aug 16 09:11:04 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:11:04 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:11:04 user nova-compute[73208]:       <nova:name>tempest-TestVolumeSwap-server-1221957036</nova:name>
Aug 16 09:11:04 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:11:04</nova:creationTime>
Aug 16 09:11:04 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:11:04 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:11:04 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:11:04 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:11:04 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:11:04 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:11:04 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:11:04 user nova-compute[73208]:       <nova:owner>
Aug 16 09:11:04 user nova-compute[73208]:         <nova:user uuid="7a8d8e5f626c4fce850268849137e91a">tempest-TestVolumeSwap-2048536046-project-member</nova:user>
Aug 16 09:11:04 user nova-compute[73208]:         <nova:project uuid="4cc4826a52774d7886beb8dd1f145ae0">tempest-TestVolumeSwap-2048536046</nova:project>
Aug 16 09:11:04 user nova-compute[73208]:       </nova:owner>
Aug 16 09:11:04 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:11:04 user nova-compute[73208]:       <nova:ports>
Aug 16 09:11:04 user nova-compute[73208]:         <nova:port uuid="87fdcd87-2939-41c6-9451-f9afe4d0f63a">
Aug 16 09:11:04 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 09:11:04 user nova-compute[73208]:         </nova:port>
Aug 16 09:11:04 user nova-compute[73208]:       </nova:ports>
Aug 16 09:11:04 user nova-compute[73208]:     </nova:instance>
Aug 16 09:11:04 user nova-compute[73208]:   </metadata>
Aug 16 09:11:04 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:11:04 user nova-compute[73208]:     <system>
Aug 16 09:11:04 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:11:04 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:11:04 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:11:04 user nova-compute[73208]:       <entry name="serial">650ba2c3-c61c-438b-8f87-79d5a98c078a</entry>
Aug 16 09:11:04 user nova-compute[73208]:       <entry name="uuid">650ba2c3-c61c-438b-8f87-79d5a98c078a</entry>
Aug 16 09:11:04 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:11:04 user nova-compute[73208]:     </system>
Aug 16 09:11:04 user nova-compute[73208]:   </sysinfo>
Aug 16 09:11:04 user nova-compute[73208]:   <os>
Aug 16 09:11:04 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:11:04 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:11:04 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:11:04 user nova-compute[73208]:   </os>
Aug 16 09:11:04 user nova-compute[73208]:   <features>
Aug 16 09:11:04 user nova-compute[73208]:     <acpi/>
Aug 16 09:11:04 user nova-compute[73208]:     <apic/>
Aug 16 09:11:04 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:11:04 user nova-compute[73208]:   </features>
Aug 16 09:11:04 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:11:04 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:11:04 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:11:04 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:11:04 user nova-compute[73208]:   </clock>
Aug 16 09:11:04 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:11:04 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:11:04 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:11:04 user nova-compute[73208]:   </cpu>
Aug 16 09:11:04 user nova-compute[73208]:   <devices>
Aug 16 09:11:04 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:11:04 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:11:04 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk"/>
Aug 16 09:11:04 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:11:04 user nova-compute[73208]:     </disk>
Aug 16 09:11:04 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:11:04 user nova-compute[73208]:       <mac address="fa:16:3e:1d:9a:a8"/>
Aug 16 09:11:04 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:04 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:11:04 user nova-compute[73208]:       <target dev="tap87fdcd87-29"/>
Aug 16 09:11:04 user nova-compute[73208]:     </interface>
Aug 16 09:11:04 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:11:04 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/console.log" append="off"/>
Aug 16 09:11:04 user nova-compute[73208]:     </serial>
Aug 16 09:11:04 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:11:04 user nova-compute[73208]:     <video>
Aug 16 09:11:04 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:04 user nova-compute[73208]:     </video>
Aug 16 09:11:04 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:11:04 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:11:04 user nova-compute[73208]:     </rng>
Aug 16 09:11:04 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:11:04 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:11:04 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:11:04 user nova-compute[73208]:     </memballoon>
Aug 16 09:11:04 user nova-compute[73208]:   </devices>
Aug 16 09:11:04 user nova-compute[73208]: </domain>
Aug 16 09:11:04 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1221957036',display_name='tempest-TestVolumeSwap-server-1221957036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1221957036',id=13,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfPN7e8Ra4v8TYV04lR36/auSxlLGZ7U8YKMQ8OBbkR4J0xvpr/rjmCUYxlrGrElb0+baayp6pOJvyTfGyQIwJkv+LoE7e/ThwY3u8h4i8JrnQr4Uf8lykDJy+MVLx5pg==',key_name='tempest-keypair-565264420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cc4826a52774d7886beb8dd1f145ae0',ramdisk_id='',reservation_id='r-nkqok5sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2048536046',owner_user_name='tempest-TestVolumeSwap-2048536046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a8d8e5f626c4fce850268849137e91a',uuid=650ba2c3-c61c-438b-8f87-79d5a98c078a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Converting VIF {"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=87fdcd87-2939-41c6-9451-f9afe4d0f63a,network=Network(a93cdfd8-98f5-450e-afba-c6ac70d4b657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcd87-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG os_vif [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=87fdcd87-2939-41c6-9451-f9afe4d0f63a,network=Network(a93cdfd8-98f5-450e-afba-c6ac70d4b657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcd87-29') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87fdcd87-29, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87fdcd87-29, col_values=(('external_ids', {'iface-id': '87fdcd87-2939-41c6-9451-f9afe4d0f63a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:9a:a8', 'vm-uuid': '650ba2c3-c61c-438b-8f87-79d5a98c078a'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.246s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Checking if we can resize image /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk. size=21474836480 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:04 user nova-compute[73208]: INFO os_vif [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=87fdcd87-2939-41c6-9451-f9afe4d0f63a,network=Network(a93cdfd8-98f5-450e-afba-c6ac70d4b657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcd87-29')
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] No VIF found with MAC fa:16:3e:1d:9a:a8, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk 21474836480 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk 21474836480" returned: 0 in 0.219s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Ensure instance console log exists: /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Start _get_guest_xml network_info=[{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1879811333-network", "vif_mac": "fa:16:3e:e0:7b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '8d7aaa6f-8072-47cd-b050-f87b01f66347', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'beb4ea79-b782-4540-8814-09b15002b432', 'attached_at': '2023-08-16T09:11:04.000000', 'detached_at': '', 'volume_id': '9a7dc374-5cdb-4b8c-a439-828bd4f0c44c', 'serial': '9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:11:04 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:04 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:11:04 user nova-compute[73208]: DEBUG nova.objects.instance [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'vcpu_model' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:11:05 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:11:05 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:11:05 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[90028db5-a94b-4746-a338-caf0b05b624f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:11:05 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[84629f5b-dd4d-42b0-9e1c-168345d2fbfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c] added
Aug 16 09:11:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-fcd2703c-36bc-42d2-908e-4f74aaa2d204 req-145dd333-c43e-4a3b-8770-767308038bd4 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Updated VIF entry in instance network info cache for port 87fdcd87-2939-41c6-9451-f9afe4d0f63a. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-fcd2703c-36bc-42d2-908e-4f74aaa2d204 req-145dd333-c43e-4a3b-8770-767308038bd4 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Updating instance_info_cache with network_info: [{"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e7798a-afdd-41e4-82a3-992cca317b54]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fcd2703c-36bc-42d2-908e-4f74aaa2d204 req-145dd333-c43e-4a3b-8770-767308038bd4 service nova] Releasing lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b97ea-4892-46f1-8c2f-51dacbb86183]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOIMXevc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOIMXevc" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c874308-db77-48cf-a0f5-88cd001f18fe]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zOIMXevc'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e2822f-45dd-4dee-b0fd-090af2510231]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c177a-81af-48a5-9651-0e99cfc24662]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:05 user nova-compute[73208]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:11:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:05 user nova-compute[73208]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:11:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaab52e-de30-40e3-a420-58f88485abf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]
Aug 16 09:11:05 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.
Aug 16 09:11:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bbddff-38c4-438d-9aa4-e6baddfa363d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba15704b-bfce-44e7-b1bc-4c044eff06a8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:05 user nova-compute[73208]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:11:05 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:11:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:11:05 user nova-compute[73208]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:11:05 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:11:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d864a6-9b97-4b97-a701-5aa2f44f566b]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:05 user nova-compute[73208]: WARNING nova.compute.manager [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state stopped and task_state powering-on.
Aug 16 09:11:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:05 user nova-compute[73208]: WARNING nova.compute.manager [req-76dcc0a0-c293-41b8-a16c-cc6e795b0712 req-53094c91-77d8-4f66-9040-95c5f8a172e5 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state stopped and task_state powering-on.
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26337663336363830', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337663336363830', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1879811333-network", "vif_mac": "fa:16:3e:e0:7b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1879811333-network", "vif_mac": "fa:16:3e:e0:7b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:11:06 user nova-compute[73208]:   <uuid>beb4ea79-b782-4540-8814-09b15002b432</uuid>
Aug 16 09:11:06 user nova-compute[73208]:   <name>instance-00000004</name>
Aug 16 09:11:06 user nova-compute[73208]:   <memory>2097152</memory>
Aug 16 09:11:06 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:11:06 user nova-compute[73208]:   <metadata>
Aug 16 09:11:06 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:11:06 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:11:06 user nova-compute[73208]:       <nova:name>tempest-ServerActionsTestOtherB-server-516370955</nova:name>
Aug 16 09:11:06 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:11:04</nova:creationTime>
Aug 16 09:11:06 user nova-compute[73208]:       <nova:flavor name="m1.small">
Aug 16 09:11:06 user nova-compute[73208]:         <nova:memory>2048</nova:memory>
Aug 16 09:11:06 user nova-compute[73208]:         <nova:disk>20</nova:disk>
Aug 16 09:11:06 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:11:06 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:11:06 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:11:06 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:11:06 user nova-compute[73208]:       <nova:owner>
Aug 16 09:11:06 user nova-compute[73208]:         <nova:user uuid="e55042930262469a9989e0b9eaf44419">tempest-ServerActionsTestOtherB-1962627754-project-member</nova:user>
Aug 16 09:11:06 user nova-compute[73208]:         <nova:project uuid="cc6f44a553f04c2288bdfa3593f90f87">tempest-ServerActionsTestOtherB-1962627754</nova:project>
Aug 16 09:11:06 user nova-compute[73208]:       </nova:owner>
Aug 16 09:11:06 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:11:06 user nova-compute[73208]:       <nova:ports>
Aug 16 09:11:06 user nova-compute[73208]:         <nova:port uuid="9b934682-5a56-428d-8362-8cb499a85a94">
Aug 16 09:11:06 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 09:11:06 user nova-compute[73208]:         </nova:port>
Aug 16 09:11:06 user nova-compute[73208]:       </nova:ports>
Aug 16 09:11:06 user nova-compute[73208]:     </nova:instance>
Aug 16 09:11:06 user nova-compute[73208]:   </metadata>
Aug 16 09:11:06 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:11:06 user nova-compute[73208]:     <system>
Aug 16 09:11:06 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:11:06 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:11:06 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:11:06 user nova-compute[73208]:       <entry name="serial">beb4ea79-b782-4540-8814-09b15002b432</entry>
Aug 16 09:11:06 user nova-compute[73208]:       <entry name="uuid">beb4ea79-b782-4540-8814-09b15002b432</entry>
Aug 16 09:11:06 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:11:06 user nova-compute[73208]:     </system>
Aug 16 09:11:06 user nova-compute[73208]:   </sysinfo>
Aug 16 09:11:06 user nova-compute[73208]:   <os>
Aug 16 09:11:06 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:11:06 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:11:06 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:11:06 user nova-compute[73208]:   </os>
Aug 16 09:11:06 user nova-compute[73208]:   <features>
Aug 16 09:11:06 user nova-compute[73208]:     <acpi/>
Aug 16 09:11:06 user nova-compute[73208]:     <apic/>
Aug 16 09:11:06 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:11:06 user nova-compute[73208]:   </features>
Aug 16 09:11:06 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:11:06 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:11:06 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:11:06 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:11:06 user nova-compute[73208]:   </clock>
Aug 16 09:11:06 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:11:06 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:11:06 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:11:06 user nova-compute[73208]:   </cpu>
Aug 16 09:11:06 user nova-compute[73208]:   <devices>
Aug 16 09:11:06 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:11:06 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:11:06 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk"/>
Aug 16 09:11:06 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:11:06 user nova-compute[73208]:     </disk>
Aug 16 09:11:06 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:11:06 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:11:06 user nova-compute[73208]:       <source dev="/dev/sdd"/>
Aug 16 09:11:06 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:11:06 user nova-compute[73208]:       <serial>9a7dc374-5cdb-4b8c-a439-828bd4f0c44c</serial>
Aug 16 09:11:06 user nova-compute[73208]:     </disk>
Aug 16 09:11:06 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:11:06 user nova-compute[73208]:       <mac address="fa:16:3e:e0:7b:07"/>
Aug 16 09:11:06 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:06 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:11:06 user nova-compute[73208]:       <target dev="tap9b934682-5a"/>
Aug 16 09:11:06 user nova-compute[73208]:     </interface>
Aug 16 09:11:06 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:11:06 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/console.log" append="off"/>
Aug 16 09:11:06 user nova-compute[73208]:     </serial>
Aug 16 09:11:06 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:11:06 user nova-compute[73208]:     <video>
Aug 16 09:11:06 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:06 user nova-compute[73208]:     </video>
Aug 16 09:11:06 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:11:06 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:11:06 user nova-compute[73208]:     </rng>
Aug 16 09:11:06 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:11:06 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:11:06 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:11:06 user nova-compute[73208]:     </memballoon>
Aug 16 09:11:06 user nova-compute[73208]:   </devices>
Aug 16 09:11:06 user nova-compute[73208]: </domain>
Aug 16 09:11:06 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1879811333-network", "vif_mac": "fa:16:3e:e0:7b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1879811333-network", "vif_mac": "fa:16:3e:e0:7b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG os_vif [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b934682-5a, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b934682-5a, col_values=(('external_ids', {'iface-id': '9b934682-5a56-428d-8362-8cb499a85a94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:7b:07', 'vm-uuid': 'beb4ea79-b782-4540-8814-09b15002b432'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:11:06 user nova-compute[73208]: INFO os_vif [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a')
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] No VIF found with MAC fa:16:3e:e0:7b:07, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-5385b190-0dc0-4f4e-b66b-4ba32460d38e req-18ca3ea8-46c5-40b4-9924-30df1302c592 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received event network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5385b190-0dc0-4f4e-b66b-4ba32460d38e req-18ca3ea8-46c5-40b4-9924-30df1302c592 service nova] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5385b190-0dc0-4f4e-b66b-4ba32460d38e req-18ca3ea8-46c5-40b4-9924-30df1302c592 service nova] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5385b190-0dc0-4f4e-b66b-4ba32460d38e req-18ca3ea8-46c5-40b4-9924-30df1302c592 service nova] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-5385b190-0dc0-4f4e-b66b-4ba32460d38e req-18ca3ea8-46c5-40b4-9924-30df1302c592 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] No waiting events found dispatching network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:06 user nova-compute[73208]: WARNING nova.compute.manager [req-5385b190-0dc0-4f4e-b66b-4ba32460d38e req-18ca3ea8-46c5-40b4-9924-30df1302c592 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received unexpected event network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a for instance with vm_state building and task_state spawning.
Aug 16 09:11:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177068.3186707, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Resumed (Lifecycle Event)
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:11:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance rebooted successfully.
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3d7fe32f-dd55-487c-b0e3-020852ca3e8e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177068.3205662, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Started (Lifecycle Event)
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d43d628-ebec-426f-b636-f1dccb377c53 req-4632ae47-5e67-4a1b-83de-fb7759108372 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d43d628-ebec-426f-b636-f1dccb377c53 req-4632ae47-5e67-4a1b-83de-fb7759108372 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d43d628-ebec-426f-b636-f1dccb377c53 req-4632ae47-5e67-4a1b-83de-fb7759108372 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d43d628-ebec-426f-b636-f1dccb377c53 req-4632ae47-5e67-4a1b-83de-fb7759108372 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d43d628-ebec-426f-b636-f1dccb377c53 req-4632ae47-5e67-4a1b-83de-fb7759108372 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:08 user nova-compute[73208]: WARNING nova.compute.manager [req-3d43d628-ebec-426f-b636-f1dccb377c53 req-4632ae47-5e67-4a1b-83de-fb7759108372 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state resize_finish.
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-171b5448-90dc-49c2-be35-b20933db133f req-ed4aaaf3-7309-4874-8b87-7840fe864bf4 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received event network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-171b5448-90dc-49c2-be35-b20933db133f req-ed4aaaf3-7309-4874-8b87-7840fe864bf4 service nova] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-171b5448-90dc-49c2-be35-b20933db133f req-ed4aaaf3-7309-4874-8b87-7840fe864bf4 service nova] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-171b5448-90dc-49c2-be35-b20933db133f req-ed4aaaf3-7309-4874-8b87-7840fe864bf4 service nova] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-171b5448-90dc-49c2-be35-b20933db133f req-ed4aaaf3-7309-4874-8b87-7840fe864bf4 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] No waiting events found dispatching network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:08 user nova-compute[73208]: WARNING nova.compute.manager [req-171b5448-90dc-49c2-be35-b20933db133f req-ed4aaaf3-7309-4874-8b87-7840fe864bf4 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received unexpected event network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a for instance with vm_state building and task_state spawning.
Aug 16 09:11:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177069.664373, 650ba2c3-c61c-438b-8f87-79d5a98c078a => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] VM Resumed (Lifecycle Event)
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:11:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Instance spawned successfully.
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177069.6709409, 650ba2c3-c61c-438b-8f87-79d5a98c078a => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] VM Started (Lifecycle Event)
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:11:09 user nova-compute[73208]: INFO nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Took 8.23 seconds to spawn the instance on the hypervisor.
Aug 16 09:11:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:09 user nova-compute[73208]: INFO nova.compute.manager [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Took 9.17 seconds to build instance.
Aug 16 09:11:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-426b3483-b77a-463d-ab4e-5f7d6bbe12e5 tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.339s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-33b1d19f-757b-41f9-b386-a7fd841c15ed req-90eca00f-95ba-4fb1-b141-b734bbefdb55 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33b1d19f-757b-41f9-b386-a7fd841c15ed req-90eca00f-95ba-4fb1-b141-b734bbefdb55 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33b1d19f-757b-41f9-b386-a7fd841c15ed req-90eca00f-95ba-4fb1-b141-b734bbefdb55 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33b1d19f-757b-41f9-b386-a7fd841c15ed req-90eca00f-95ba-4fb1-b141-b734bbefdb55 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-33b1d19f-757b-41f9-b386-a7fd841c15ed req-90eca00f-95ba-4fb1-b141-b734bbefdb55 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:10 user nova-compute[73208]: WARNING nova.compute.manager [req-33b1d19f-757b-41f9-b386-a7fd841c15ed req-90eca00f-95ba-4fb1-b141-b734bbefdb55 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state resize_finish.
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177071.2044606, beb4ea79-b782-4540-8814-09b15002b432 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Resumed (Lifecycle Event)
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:11:11 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance running successfully.
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Failed to set time: agent not configured {{(pid=73208) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af1cdf21-939c-41f0-8aa0-0fcb08dcd1b1 tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] finish_migration finished successfully. {{(pid=73208) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177071.2089062, beb4ea79-b782-4540-8814-09b15002b432 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Started (Lifecycle Event)
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 09:11:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:11:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:11:14 user nova-compute[73208]: INFO nova.compute.claims [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Claim successful on node user
Aug 16 09:11:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:11:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.policy [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6781955ea214886b8250d8899286cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be673f546e46a9852d6f6082a9f4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:11:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Creating image(s)
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "/opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "/opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "/opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.238s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.232s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk 1073741824" returned: 0 in 0.056s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.303s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Successfully created port: 8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Cannot resize image /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'migration_context' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Ensure instance console log exists: /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:11:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Successfully updated port: 8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquired lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-c3f3e556-d158-4a2e-9408-e8c43ec60b3c req-d05f5a09-a0a2-4662-a9cd-9cd8c843ec6c service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received event network-changed-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-c3f3e556-d158-4a2e-9408-e8c43ec60b3c req-d05f5a09-a0a2-4662-a9cd-9cd8c843ec6c service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Refreshing instance network info cache due to event network-changed-8225a859-e184-4a24-a5be-864093af543b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c3f3e556-d158-4a2e-9408-e8c43ec60b3c req-d05f5a09-a0a2-4662-a9cd-9cd8c843ec6c service nova] Acquiring lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updating instance_info_cache with network_info: [{"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Releasing lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Instance network_info: |[{"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c3f3e556-d158-4a2e-9408-e8c43ec60b3c req-d05f5a09-a0a2-4662-a9cd-9cd8c843ec6c service nova] Acquired lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.network.neutron [req-c3f3e556-d158-4a2e-9408-e8c43ec60b3c req-d05f5a09-a0a2-4662-a9cd-9cd8c843ec6c service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Refreshing network info cache for port 8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Start _get_guest_xml network_info=[{"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:18 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:18 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-804528012',display_name='tempest-TestServerVolumeAttachmentScenario-server-804528012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-804528012',id=14,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO54hNgdr/qJugZCmBcEVWnXqRr0QerfU02slGjqVwPOdQJIiwq6Kbdh5D6GS+9uogzKFhYM0Hi7xiKiV3t9cevwRNGKPMKABSEF7u0twYhVXD3nxnW0ae8QWLjoPYaf+w==',key_name='tempest-keypair-1451333951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3be673f546e46a9852d6f6082a9f4ba',ramdisk_id='',reservation_id='r-2eadjpb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1013943466',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1013943466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6781955ea214886b8250d8899286cd2',uuid=866a499a-2f3f-4922-baf8-4aa0f821817b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Converting VIF {"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ad:94,bridge_name='br-int',has_traffic_filtering=True,id=8225a859-e184-4a24-a5be-864093af543b,network=Network(b240c104-0967-41e8-bcdc-136956a42c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8225a859-e1') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'pci_devices' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:11:18 user nova-compute[73208]:   <uuid>866a499a-2f3f-4922-baf8-4aa0f821817b</uuid>
Aug 16 09:11:18 user nova-compute[73208]:   <name>instance-0000000e</name>
Aug 16 09:11:18 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:11:18 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:11:18 user nova-compute[73208]:   <metadata>
Aug 16 09:11:18 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:11:18 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:11:18 user nova-compute[73208]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-804528012</nova:name>
Aug 16 09:11:18 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:11:18</nova:creationTime>
Aug 16 09:11:18 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:11:18 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:11:18 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:11:18 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:11:18 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:11:18 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:11:18 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:11:18 user nova-compute[73208]:       <nova:owner>
Aug 16 09:11:18 user nova-compute[73208]:         <nova:user uuid="d6781955ea214886b8250d8899286cd2">tempest-TestServerVolumeAttachmentScenario-1013943466-project-member</nova:user>
Aug 16 09:11:18 user nova-compute[73208]:         <nova:project uuid="f3be673f546e46a9852d6f6082a9f4ba">tempest-TestServerVolumeAttachmentScenario-1013943466</nova:project>
Aug 16 09:11:18 user nova-compute[73208]:       </nova:owner>
Aug 16 09:11:18 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:11:18 user nova-compute[73208]:       <nova:ports>
Aug 16 09:11:18 user nova-compute[73208]:         <nova:port uuid="8225a859-e184-4a24-a5be-864093af543b">
Aug 16 09:11:18 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:11:18 user nova-compute[73208]:         </nova:port>
Aug 16 09:11:18 user nova-compute[73208]:       </nova:ports>
Aug 16 09:11:18 user nova-compute[73208]:     </nova:instance>
Aug 16 09:11:18 user nova-compute[73208]:   </metadata>
Aug 16 09:11:18 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:11:18 user nova-compute[73208]:     <system>
Aug 16 09:11:18 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:11:18 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:11:18 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:11:18 user nova-compute[73208]:       <entry name="serial">866a499a-2f3f-4922-baf8-4aa0f821817b</entry>
Aug 16 09:11:18 user nova-compute[73208]:       <entry name="uuid">866a499a-2f3f-4922-baf8-4aa0f821817b</entry>
Aug 16 09:11:18 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:11:18 user nova-compute[73208]:     </system>
Aug 16 09:11:18 user nova-compute[73208]:   </sysinfo>
Aug 16 09:11:18 user nova-compute[73208]:   <os>
Aug 16 09:11:18 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:11:18 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:11:18 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:11:18 user nova-compute[73208]:   </os>
Aug 16 09:11:18 user nova-compute[73208]:   <features>
Aug 16 09:11:18 user nova-compute[73208]:     <acpi/>
Aug 16 09:11:18 user nova-compute[73208]:     <apic/>
Aug 16 09:11:18 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:11:18 user nova-compute[73208]:   </features>
Aug 16 09:11:18 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:11:18 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:11:18 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:11:18 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:11:18 user nova-compute[73208]:   </clock>
Aug 16 09:11:18 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:11:18 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:11:18 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:11:18 user nova-compute[73208]:   </cpu>
Aug 16 09:11:18 user nova-compute[73208]:   <devices>
Aug 16 09:11:18 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:11:18 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:11:18 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk"/>
Aug 16 09:11:18 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:11:18 user nova-compute[73208]:     </disk>
Aug 16 09:11:18 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:11:18 user nova-compute[73208]:       <mac address="fa:16:3e:6f:ad:94"/>
Aug 16 09:11:18 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:18 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:11:18 user nova-compute[73208]:       <target dev="tap8225a859-e1"/>
Aug 16 09:11:18 user nova-compute[73208]:     </interface>
Aug 16 09:11:18 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:11:18 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/console.log" append="off"/>
Aug 16 09:11:18 user nova-compute[73208]:     </serial>
Aug 16 09:11:18 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:11:18 user nova-compute[73208]:     <video>
Aug 16 09:11:18 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:18 user nova-compute[73208]:     </video>
Aug 16 09:11:18 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:11:18 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:11:18 user nova-compute[73208]:     </rng>
Aug 16 09:11:18 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:11:18 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:11:18 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:11:18 user nova-compute[73208]:     </memballoon>
Aug 16 09:11:18 user nova-compute[73208]:   </devices>
Aug 16 09:11:18 user nova-compute[73208]: </domain>
Aug 16 09:11:18 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-804528012',display_name='tempest-TestServerVolumeAttachmentScenario-server-804528012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-804528012',id=14,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO54hNgdr/qJugZCmBcEVWnXqRr0QerfU02slGjqVwPOdQJIiwq6Kbdh5D6GS+9uogzKFhYM0Hi7xiKiV3t9cevwRNGKPMKABSEF7u0twYhVXD3nxnW0ae8QWLjoPYaf+w==',key_name='tempest-keypair-1451333951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3be673f546e46a9852d6f6082a9f4ba',ramdisk_id='',reservation_id='r-2eadjpb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1013943466',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1013943466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6781955ea214886b8250d8899286cd2',uuid=866a499a-2f3f-4922-baf8-4aa0f821817b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Converting VIF {"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ad:94,bridge_name='br-int',has_traffic_filtering=True,id=8225a859-e184-4a24-a5be-864093af543b,network=Network(b240c104-0967-41e8-bcdc-136956a42c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8225a859-e1') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG os_vif [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ad:94,bridge_name='br-int',has_traffic_filtering=True,id=8225a859-e184-4a24-a5be-864093af543b,network=Network(b240c104-0967-41e8-bcdc-136956a42c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8225a859-e1') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8225a859-e1, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8225a859-e1, col_values=(('external_ids', {'iface-id': '8225a859-e184-4a24-a5be-864093af543b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:ad:94', 'vm-uuid': '866a499a-2f3f-4922-baf8-4aa0f821817b'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:18 user nova-compute[73208]: INFO os_vif [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ad:94,bridge_name='br-int',has_traffic_filtering=True,id=8225a859-e184-4a24-a5be-864093af543b,network=Network(b240c104-0967-41e8-bcdc-136956a42c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8225a859-e1')
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No VIF found with MAC fa:16:3e:6f:ad:94, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:11:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG nova.network.neutron [req-c3f3e556-d158-4a2e-9408-e8c43ec60b3c req-d05f5a09-a0a2-4662-a9cd-9cd8c843ec6c service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updated VIF entry in instance network info cache for port 8225a859-e184-4a24-a5be-864093af543b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG nova.network.neutron [req-c3f3e556-d158-4a2e-9408-e8c43ec60b3c req-d05f5a09-a0a2-4662-a9cd-9cd8c843ec6c service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updating instance_info_cache with network_info: [{"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c3f3e556-d158-4a2e-9408-e8c43ec60b3c req-d05f5a09-a0a2-4662-a9cd-9cd8c843ec6c service nova] Releasing lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177083.3053045, 866a499a-2f3f-4922-baf8-4aa0f821817b => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:23 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] VM Resumed (Lifecycle Event)
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-e04131f7-464b-44f9-b5a8-90eca4625b56 req-c2843e61-5c74-49e0-895d-7151b81008c5 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received event network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e04131f7-464b-44f9-b5a8-90eca4625b56 req-c2843e61-5c74-49e0-895d-7151b81008c5 service nova] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e04131f7-464b-44f9-b5a8-90eca4625b56 req-c2843e61-5c74-49e0-895d-7151b81008c5 service nova] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e04131f7-464b-44f9-b5a8-90eca4625b56 req-c2843e61-5c74-49e0-895d-7151b81008c5 service nova] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-e04131f7-464b-44f9-b5a8-90eca4625b56 req-c2843e61-5c74-49e0-895d-7151b81008c5 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] No waiting events found dispatching network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:23 user nova-compute[73208]: WARNING nova.compute.manager [req-e04131f7-464b-44f9-b5a8-90eca4625b56 req-c2843e61-5c74-49e0-895d-7151b81008c5 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received unexpected event network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b for instance with vm_state building and task_state spawning.
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-7643d001-483f-4536-99a2-f71f419e4af3 req-858617f7-cc3f-4321-9b35-e5d80b92b7c2 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received event network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7643d001-483f-4536-99a2-f71f419e4af3 req-858617f7-cc3f-4321-9b35-e5d80b92b7c2 service nova] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7643d001-483f-4536-99a2-f71f419e4af3 req-858617f7-cc3f-4321-9b35-e5d80b92b7c2 service nova] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7643d001-483f-4536-99a2-f71f419e4af3 req-858617f7-cc3f-4321-9b35-e5d80b92b7c2 service nova] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-7643d001-483f-4536-99a2-f71f419e4af3 req-858617f7-cc3f-4321-9b35-e5d80b92b7c2 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] No waiting events found dispatching network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:23 user nova-compute[73208]: WARNING nova.compute.manager [req-7643d001-483f-4536-99a2-f71f419e4af3 req-858617f7-cc3f-4321-9b35-e5d80b92b7c2 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received unexpected event network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b for instance with vm_state building and task_state spawning.
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:11:23 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:23 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7995MB free_disk=25.762165069580078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:23 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Instance spawned successfully.
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:11:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:24 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177083.3054771, 866a499a-2f3f-4922-baf8-4aa0f821817b => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:24 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] VM Started (Lifecycle Event)
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Applying migration context for instance beb4ea79-b782-4540-8814-09b15002b432 as it has an incoming, in-progress migration f70695c7-f599-43fa-a3f6-f5ae22102d99. Migration status is finished {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 09:11:24 user nova-compute[73208]: INFO nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating resource usage from migration f70695c7-f599-43fa-a3f6-f5ae22102d99
Aug 16 09:11:24 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:11:24 user nova-compute[73208]: INFO nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Took 8.72 seconds to spawn the instance on the hypervisor.
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Migration f70695c7-f599-43fa-a3f6-f5ae22102d99 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 650ba2c3-c61c-438b-8f87-79d5a98c078a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 866a499a-2f3f-4922-baf8-4aa0f821817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:11:24 user nova-compute[73208]: INFO nova.compute.manager [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Took 9.92 seconds to build instance.
Aug 16 09:11:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bc672ba-9269-47ed-8d6c-9feedfadc832 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.099s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:25 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:25 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating instance_info_cache with network_info: [{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:11:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:11:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:11:48 user nova-compute[73208]: INFO nova.compute.claims [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Claim successful on node user
Aug 16 09:11:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:48 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:11:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:11:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG nova.policy [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f3eaa6fc3874b69be9f2859fce19859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b8280bca294bb6b9024f6967806d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:11:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Creating image(s)
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "/opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "/opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "/opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.229s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk 1073741824" returned: 0 in 0.149s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.386s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Successfully created port: 4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.221s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Cannot resize image /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG nova.objects.instance [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lazy-loading 'migration_context' on Instance uuid 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Ensure instance console log exists: /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Successfully updated port: 4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquired lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-9674bf83-4842-45ff-85ca-8e783f9e8cd2 req-12430cc5-f888-417d-9513-c4aaf84df8ad service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received event network-changed-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-9674bf83-4842-45ff-85ca-8e783f9e8cd2 req-12430cc5-f888-417d-9513-c4aaf84df8ad service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Refreshing instance network info cache due to event network-changed-4fb59cce-601d-4b87-870f-116f52b38065. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9674bf83-4842-45ff-85ca-8e783f9e8cd2 req-12430cc5-f888-417d-9513-c4aaf84df8ad service nova] Acquiring lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updating instance_info_cache with network_info: [{"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Releasing lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Instance network_info: |[{"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9674bf83-4842-45ff-85ca-8e783f9e8cd2 req-12430cc5-f888-417d-9513-c4aaf84df8ad service nova] Acquired lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.neutron [req-9674bf83-4842-45ff-85ca-8e783f9e8cd2 req-12430cc5-f888-417d-9513-c4aaf84df8ad service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Refreshing network info cache for port 4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Start _get_guest_xml network_info=[{"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:11:51 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:51 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1776460898',display_name='tempest-VolumesAdminNegativeTest-server-1776460898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1776460898',id=15,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLka2f5544wbEqMOL3txvsb32QBpYWll+c2FBoOodpWIsHZ1pfzCZ4YECOoUhlYrUaulr7xKpNYppI8lYdybg6PRII6mH6b9lAOZeOAEg9cQoOdMXyYZnov+Zw3gifvMYQ==',key_name='tempest-keypair-1380364193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75b8280bca294bb6b9024f6967806d62',ramdisk_id='',reservation_id='r-njwyt0dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-840118071',owner_user_name='tempest-VolumesAdminNegativeTest-840118071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f3eaa6fc3874b69be9f2859fce19859',uuid=4421648d-a4a2-4ab2-8c13-6fbf08b0e42a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converting VIF {"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:74:3d,bridge_name='br-int',has_traffic_filtering=True,id=4fb59cce-601d-4b87-870f-116f52b38065,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb59cce-60') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.objects.instance [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lazy-loading 'pci_devices' on Instance uuid 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:11:51 user nova-compute[73208]:   <uuid>4421648d-a4a2-4ab2-8c13-6fbf08b0e42a</uuid>
Aug 16 09:11:51 user nova-compute[73208]:   <name>instance-0000000f</name>
Aug 16 09:11:51 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:11:51 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:11:51 user nova-compute[73208]:   <metadata>
Aug 16 09:11:51 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:11:51 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:11:51 user nova-compute[73208]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1776460898</nova:name>
Aug 16 09:11:51 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:11:51</nova:creationTime>
Aug 16 09:11:51 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:11:51 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:11:51 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:11:51 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:11:51 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:11:51 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:11:51 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:11:51 user nova-compute[73208]:       <nova:owner>
Aug 16 09:11:51 user nova-compute[73208]:         <nova:user uuid="1f3eaa6fc3874b69be9f2859fce19859">tempest-VolumesAdminNegativeTest-840118071-project-member</nova:user>
Aug 16 09:11:51 user nova-compute[73208]:         <nova:project uuid="75b8280bca294bb6b9024f6967806d62">tempest-VolumesAdminNegativeTest-840118071</nova:project>
Aug 16 09:11:51 user nova-compute[73208]:       </nova:owner>
Aug 16 09:11:51 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:11:51 user nova-compute[73208]:       <nova:ports>
Aug 16 09:11:51 user nova-compute[73208]:         <nova:port uuid="4fb59cce-601d-4b87-870f-116f52b38065">
Aug 16 09:11:51 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 09:11:51 user nova-compute[73208]:         </nova:port>
Aug 16 09:11:51 user nova-compute[73208]:       </nova:ports>
Aug 16 09:11:51 user nova-compute[73208]:     </nova:instance>
Aug 16 09:11:51 user nova-compute[73208]:   </metadata>
Aug 16 09:11:51 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:11:51 user nova-compute[73208]:     <system>
Aug 16 09:11:51 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:11:51 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:11:51 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:11:51 user nova-compute[73208]:       <entry name="serial">4421648d-a4a2-4ab2-8c13-6fbf08b0e42a</entry>
Aug 16 09:11:51 user nova-compute[73208]:       <entry name="uuid">4421648d-a4a2-4ab2-8c13-6fbf08b0e42a</entry>
Aug 16 09:11:51 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:11:51 user nova-compute[73208]:     </system>
Aug 16 09:11:51 user nova-compute[73208]:   </sysinfo>
Aug 16 09:11:51 user nova-compute[73208]:   <os>
Aug 16 09:11:51 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:11:51 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:11:51 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:11:51 user nova-compute[73208]:   </os>
Aug 16 09:11:51 user nova-compute[73208]:   <features>
Aug 16 09:11:51 user nova-compute[73208]:     <acpi/>
Aug 16 09:11:51 user nova-compute[73208]:     <apic/>
Aug 16 09:11:51 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:11:51 user nova-compute[73208]:   </features>
Aug 16 09:11:51 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:11:51 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:11:51 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:11:51 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:11:51 user nova-compute[73208]:   </clock>
Aug 16 09:11:51 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:11:51 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:11:51 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:11:51 user nova-compute[73208]:   </cpu>
Aug 16 09:11:51 user nova-compute[73208]:   <devices>
Aug 16 09:11:51 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:11:51 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:11:51 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk"/>
Aug 16 09:11:51 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:11:51 user nova-compute[73208]:     </disk>
Aug 16 09:11:51 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:11:51 user nova-compute[73208]:       <mac address="fa:16:3e:e1:74:3d"/>
Aug 16 09:11:51 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:51 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:11:51 user nova-compute[73208]:       <target dev="tap4fb59cce-60"/>
Aug 16 09:11:51 user nova-compute[73208]:     </interface>
Aug 16 09:11:51 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:11:51 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/console.log" append="off"/>
Aug 16 09:11:51 user nova-compute[73208]:     </serial>
Aug 16 09:11:51 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:11:51 user nova-compute[73208]:     <video>
Aug 16 09:11:51 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:11:51 user nova-compute[73208]:     </video>
Aug 16 09:11:51 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:11:51 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:11:51 user nova-compute[73208]:     </rng>
Aug 16 09:11:51 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:11:51 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:11:51 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:11:51 user nova-compute[73208]:     </memballoon>
Aug 16 09:11:51 user nova-compute[73208]:   </devices>
Aug 16 09:11:51 user nova-compute[73208]: </domain>
Aug 16 09:11:51 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1776460898',display_name='tempest-VolumesAdminNegativeTest-server-1776460898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1776460898',id=15,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLka2f5544wbEqMOL3txvsb32QBpYWll+c2FBoOodpWIsHZ1pfzCZ4YECOoUhlYrUaulr7xKpNYppI8lYdybg6PRII6mH6b9lAOZeOAEg9cQoOdMXyYZnov+Zw3gifvMYQ==',key_name='tempest-keypair-1380364193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75b8280bca294bb6b9024f6967806d62',ramdisk_id='',reservation_id='r-njwyt0dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-840118071',owner_user_name='tempest-VolumesAdminNegativeTest-840118071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f3eaa6fc3874b69be9f2859fce19859',uuid=4421648d-a4a2-4ab2-8c13-6fbf08b0e42a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converting VIF {"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:74:3d,bridge_name='br-int',has_traffic_filtering=True,id=4fb59cce-601d-4b87-870f-116f52b38065,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb59cce-60') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG os_vif [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:74:3d,bridge_name='br-int',has_traffic_filtering=True,id=4fb59cce-601d-4b87-870f-116f52b38065,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb59cce-60') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fb59cce-60, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fb59cce-60, col_values=(('external_ids', {'iface-id': '4fb59cce-601d-4b87-870f-116f52b38065', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:74:3d', 'vm-uuid': '4421648d-a4a2-4ab2-8c13-6fbf08b0e42a'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:51 user nova-compute[73208]: INFO os_vif [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:74:3d,bridge_name='br-int',has_traffic_filtering=True,id=4fb59cce-601d-4b87-870f-116f52b38065,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb59cce-60')
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] No VIF found with MAC fa:16:3e:e1:74:3d, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.neutron [req-9674bf83-4842-45ff-85ca-8e783f9e8cd2 req-12430cc5-f888-417d-9513-c4aaf84df8ad service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updated VIF entry in instance network info cache for port 4fb59cce-601d-4b87-870f-116f52b38065. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:11:51 user nova-compute[73208]: DEBUG nova.network.neutron [req-9674bf83-4842-45ff-85ca-8e783f9e8cd2 req-12430cc5-f888-417d-9513-c4aaf84df8ad service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updating instance_info_cache with network_info: [{"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:11:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9674bf83-4842-45ff-85ca-8e783f9e8cd2 req-12430cc5-f888-417d-9513-c4aaf84df8ad service nova] Releasing lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee353995-c676-4f9e-8105-71eff406fe3d req-2df863b2-ad41-49c4-8770-3df3cb544dde service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received event network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee353995-c676-4f9e-8105-71eff406fe3d req-2df863b2-ad41-49c4-8770-3df3cb544dde service nova] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee353995-c676-4f9e-8105-71eff406fe3d req-2df863b2-ad41-49c4-8770-3df3cb544dde service nova] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee353995-c676-4f9e-8105-71eff406fe3d req-2df863b2-ad41-49c4-8770-3df3cb544dde service nova] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee353995-c676-4f9e-8105-71eff406fe3d req-2df863b2-ad41-49c4-8770-3df3cb544dde service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] No waiting events found dispatching network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:53 user nova-compute[73208]: WARNING nova.compute.manager [req-ee353995-c676-4f9e-8105-71eff406fe3d req-2df863b2-ad41-49c4-8770-3df3cb544dde service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received unexpected event network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 for instance with vm_state building and task_state spawning.
Aug 16 09:11:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177115.5193703, 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] VM Resumed (Lifecycle Event)
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:11:55 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Instance spawned successfully.
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177115.5196373, 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:11:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] VM Started (Lifecycle Event)
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-d0aeb4f5-0377-4cba-a802-24bd4b19709a req-198db579-ce11-43e3-9e89-e6afc568230b service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received event network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0aeb4f5-0377-4cba-a802-24bd4b19709a req-198db579-ce11-43e3-9e89-e6afc568230b service nova] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0aeb4f5-0377-4cba-a802-24bd4b19709a req-198db579-ce11-43e3-9e89-e6afc568230b service nova] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0aeb4f5-0377-4cba-a802-24bd4b19709a req-198db579-ce11-43e3-9e89-e6afc568230b service nova] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-d0aeb4f5-0377-4cba-a802-24bd4b19709a req-198db579-ce11-43e3-9e89-e6afc568230b service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] No waiting events found dispatching network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:11:55 user nova-compute[73208]: WARNING nova.compute.manager [req-d0aeb4f5-0377-4cba-a802-24bd4b19709a req-198db579-ce11-43e3-9e89-e6afc568230b service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received unexpected event network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 for instance with vm_state building and task_state spawning.
Aug 16 09:11:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:11:55 user nova-compute[73208]: INFO nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 16 09:11:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:11:55 user nova-compute[73208]: INFO nova.compute.manager [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Took 7.25 seconds to build instance.
Aug 16 09:11:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88cf90c4-edf7-4be7-a4b9-953245bb96ab tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.357s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:11:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:11:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-50aa0097-ba33-453f-a3a7-e3d7e79b565e req-fa4c4349-9f7b-46a2-af8b-57ad3c74686a service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-changed-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-50aa0097-ba33-453f-a3a7-e3d7e79b565e req-fa4c4349-9f7b-46a2-af8b-57ad3c74686a service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Refreshing instance network info cache due to event network-changed-5ed694ee-58b8-47e6-ad9e-1e1235b94f86. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-50aa0097-ba33-453f-a3a7-e3d7e79b565e req-fa4c4349-9f7b-46a2-af8b-57ad3c74686a service nova] Acquiring lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-50aa0097-ba33-453f-a3a7-e3d7e79b565e req-fa4c4349-9f7b-46a2-af8b-57ad3c74686a service nova] Acquired lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG nova.network.neutron [req-50aa0097-ba33-453f-a3a7-e3d7e79b565e req-fa4c4349-9f7b-46a2-af8b-57ad3c74686a service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Refreshing network info cache for port 5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG nova.network.neutron [req-50aa0097-ba33-453f-a3a7-e3d7e79b565e req-fa4c4349-9f7b-46a2-af8b-57ad3c74686a service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Updated VIF entry in instance network info cache for port 5ed694ee-58b8-47e6-ad9e-1e1235b94f86. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG nova.network.neutron [req-50aa0097-ba33-453f-a3a7-e3d7e79b565e req-fa4c4349-9f7b-46a2-af8b-57ad3c74686a service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Updating instance_info_cache with network_info: [{"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-50aa0097-ba33-453f-a3a7-e3d7e79b565e req-fa4c4349-9f7b-46a2-af8b-57ad3c74686a service nova] Releasing lock "refresh_cache-7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG nova.objects.instance [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'flavor' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:13 user nova-compute[73208]: INFO nova.compute.manager [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Attaching volume 613d8c6f-7e7a-49af-b022-fe8dcffc85c1 to /dev/vdb
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.utils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2efac8-755b-4288-8839-a3f174b4a922]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc0887d-ad95-4707-9d0f-f84f63cc2300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2488e7-4f3d-4c37-b865-cf840f715e3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: INFO nova.compute.manager [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Detaching volume f67a4b7d-0350-4190-bc4a-a8e66fcea658
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[07402ecb-56ca-4b97-8fc8-3d8d0d0e1cea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:12:13 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9403a17a-c72e-405c-9817-9d981c181fce]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.utils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Updating existing volume attachment record: 63e12777-a4a4-4bf3-a182-0c86aeb12545 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:12:13 user nova-compute[73208]: INFO nova.virt.block_device [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Attempting to driver detach volume f67a4b7d-0350-4190-bc4a-a8e66fcea658 from mountpoint /dev/vdc
Aug 16 09:12:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Attempting to detach device vdc from instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:12:13 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:12:13 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:12:13 user nova-compute[73208]:   <target dev="vdc" bus="virtio"/>
Aug 16 09:12:13 user nova-compute[73208]:   <serial>f67a4b7d-0350-4190-bc4a-a8e66fcea658</serial>
Aug 16 09:12:13 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 09:12:13 user nova-compute[73208]: </disk>
Aug 16 09:12:13 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:12:13 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully detached device vdc from instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad from the persistent domain config.
Aug 16 09:12:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:12:13 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:12:13 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:12:13 user nova-compute[73208]:   <target dev="vdc" bus="virtio"/>
Aug 16 09:12:13 user nova-compute[73208]:   <serial>f67a4b7d-0350-4190-bc4a-a8e66fcea658</serial>
Aug 16 09:12:13 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 09:12:13 user nova-compute[73208]: </disk>
Aug 16 09:12:13 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177133.869858, 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:12:13 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully detached device vdc from instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad from the live domain config.
Aug 16 09:12:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVvtcQSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:13 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd23ab82-3d66-4ed3-90d8-4b684e609074]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[da01391e-f006-4f89-9698-e4cbd0fa8ea1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:12:13 user nova-compute[73208]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:13 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:13 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 (non-flash)
Aug 16 09:12:13 user nova-compute[73208]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:13 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:13 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6fcf07910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d01cc2-284e-4e2a-b3b7-cefe4b8ebbe1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15f0044-349f-421b-9c4a-545b4ba90913]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:13 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[70851b47-e1b2-470a-bde6-3d4a5e3b08d5]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a726cf6b-7dd6-46df-abe0-e1118dc8cd47]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1d36e8-3f6b-4661-8c67-16c9785548df]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c7148-a4d8-4316-aa65-0b2139022312]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658, portal: 172.16.0.220,3260]
Aug 16 09:12:14 user nova-compute[73208]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658, portal: 172.16.0.220,3260] successful.
Aug 16 09:12:14 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67a4b7d-0350-4190-bc4a-a8e66fcea658 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cbd59f-b2ea-43af-8c91-fc27c6b435c2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] <== disconnect_volume: return (329ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:12:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:15 user nova-compute[73208]: DEBUG nova.objects.instance [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'flavor' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b1da900-266b-4eb0-8898-e34f38cdb3b5 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.980s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:15 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:12:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:16 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:16 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:12:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:12:20 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:12:20 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:12:20 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=25.662975311279297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:12:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Applying migration context for instance beb4ea79-b782-4540-8814-09b15002b432 as it has an incoming, in-progress migration f70695c7-f599-43fa-a3f6-f5ae22102d99. Migration status is finished {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 09:12:21 user nova-compute[73208]: INFO nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating resource usage from migration f70695c7-f599-43fa-a3f6-f5ae22102d99
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Migration f70695c7-f599-43fa-a3f6-f5ae22102d99 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 650ba2c3-c61c-438b-8f87-79d5a98c078a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 866a499a-2f3f-4922-baf8-4aa0f821817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_power_states {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid aeff110f-8cbd-480d-8654-b0daee121eb7 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "beb4ea79-b782-4540-8814-09b15002b432" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "beb4ea79-b782-4540-8814-09b15002b432" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:12:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOxGDaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:24 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:24 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:24 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[849bd3db-84ea-459a-91cc-5803390a6783]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:12:24 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79ab07d-e7d8-4664-a93a-823df6d0c064]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1] added
Aug 16 09:12:24 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bebe1a-1971-4e78-8696-a5a20d9711bd]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc18eb17-a27f-442b-8bbe-183954e279b4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrOxGDaX {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrOxGDaX" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d15387-db50-4dcf-9c12-d8fb0c3448de]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nrOxGDaX'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcc8f8d-38b2-4ad1-a8c5-9124d708ab43]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4a6795-843d-4f29-9241-bd8da84bab6f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:25 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:25 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4181242-2aa1-4312-97f2-af41c51e26a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260]
Aug 16 09:12:25 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260] successful.
Aug 16 09:12:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89757e-5608-42fe-8a17-4fd4b560912d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea68b4d2-a0b2-4e9a-929f-563a5b64c001]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:25 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:25 user nova-compute[73208]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:25 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:25 user nova-compute[73208]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f1840f-0181-41f0-b91c-333144b10ab2]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:12:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOxGDaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23038386238376436', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038386238376436', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'flavor' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:12:26 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:12:26 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:12:26 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:12:26 user nova-compute[73208]:   <serial>613d8c6f-7e7a-49af-b022-fe8dcffc85c1</serial>
Aug 16 09:12:26 user nova-compute[73208]: </disk>
Aug 16 09:12:26 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No VIF found with MAC fa:16:3e:ae:42:5f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237c78bb-4c9b-4389-b391-c31719f569d0 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.753s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.448s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:27 user nova-compute[73208]: INFO nova.compute.manager [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Rebuilding instance
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'pci_requests' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'resources' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'migration_context' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73208) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-57f61dbb-9f28-4d5f-97cb-e96d9e6cd531 req-d1fa32a9-7fdb-4dc6-8f58-817a6a4059ca service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-unplugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-57f61dbb-9f28-4d5f-97cb-e96d9e6cd531 req-d1fa32a9-7fdb-4dc6-8f58-817a6a4059ca service nova] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-57f61dbb-9f28-4d5f-97cb-e96d9e6cd531 req-d1fa32a9-7fdb-4dc6-8f58-817a6a4059ca service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-57f61dbb-9f28-4d5f-97cb-e96d9e6cd531 req-d1fa32a9-7fdb-4dc6-8f58-817a6a4059ca service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-57f61dbb-9f28-4d5f-97cb-e96d9e6cd531 req-d1fa32a9-7fdb-4dc6-8f58-817a6a4059ca service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] No waiting events found dispatching network-vif-unplugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:28 user nova-compute[73208]: WARNING nova.compute.manager [req-57f61dbb-9f28-4d5f-97cb-e96d9e6cd531 req-d1fa32a9-7fdb-4dc6-8f58-817a6a4059ca service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received unexpected event network-vif-unplugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 for instance with vm_state active and task_state rebuilding.
Aug 16 09:12:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance destroyed successfully.
Aug 16 09:12:29 user nova-compute[73208]: INFO nova.compute.manager [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Detaching volume 613d8c6f-7e7a-49af-b022-fe8dcffc85c1
Aug 16 09:12:29 user nova-compute[73208]: INFO nova.virt.block_device [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Attempting to driver detach volume 613d8c6f-7e7a-49af-b022-fe8dcffc85c1 from mountpoint /dev/vdb
Aug 16 09:12:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Attempting to detach device vdb from instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:12:29 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:12:29 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:12:29 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:12:29 user nova-compute[73208]:   <serial>613d8c6f-7e7a-49af-b022-fe8dcffc85c1</serial>
Aug 16 09:12:29 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:12:29 user nova-compute[73208]: </disk>
Aug 16 09:12:29 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:12:29 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully detached device vdb from instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e from the persistent domain config.
Aug 16 09:12:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOxGDaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:29 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ab1117-9106-4ee1-8937-e183cebf6e91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeee7c3-adf2-4bb3-92b5-40eb86a4fb22]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:29 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:29 user nova-compute[73208]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:29 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:29 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:29 user nova-compute[73208]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:29 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0246dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb44ee03-8afa-4a15-9047-fb36fb4bac5b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf0b8a6-dc88-4e60-a770-7af221838b13]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b72351b-100f-4d2d-8490-01c9e973971f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9276541c-2a02-4a4f-8578-1f9fcb3e9e5e]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b99ea-001f-4154-90f9-3b028b644de4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83c13d3-8f4d-4934-9dba-cd3833657607]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260]
Aug 16 09:12:29 user nova-compute[73208]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260] successful.
Aug 16 09:12:29 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7366a9c9-adac-4da1-b20b-20c706ec3e94]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== disconnect_volume: return (272ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:12:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance destroyed successfully.
Aug 16 09:12:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-261110518',display_name='tempest-ServerActionsTestOtherA-server-184088253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-261110518',id=12,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NfBFLqJtGbvXoityJVqzPb6+0NitNd540fExHmEMlMS7yAqjRzdOfdBee660sbMv3MotVe+QM6Z8SS0UbFUtsNWJuxD1BFJ1pShsGKYPAFQnGdZtf5H8KIZhfj6YNeQ==',key_name='tempest-keypair-1107223125',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-uf33iujx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:12:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=7e4b82ae-cdb8-45af-b0ef-350096e7ec3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_vif [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ed694ee-58, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:12:30 user nova-compute[73208]: INFO os_vif [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58')
Aug 16 09:12:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOxGDaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:30 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b473b1bd-0126-4a52-aa87-8f2ab1dec92e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa4717b-2434-4546-ab61-d88f78b6065d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:30 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:30 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f024f5b0>, {}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Disconnecting from: [] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== disconnect_volume: return (54ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:12:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Deleting instance files /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e_del
Aug 16 09:12:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Deletion of /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e_del complete
Aug 16 09:12:30 user nova-compute[73208]: INFO nova.virt.block_device [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Booting with volume 613d8c6f-7e7a-49af-b022-fe8dcffc85c1 at /dev/vdb
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.utils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c49f6f5-b508-4edb-8d7d-a971f41500b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec82152-0cdd-4aa6-bd06-e74a0037a46e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57d0d78-362e-4b4a-8868-d5da596f4b99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[765fbb83-ea1a-4ec5-8dc1-d53ea6137f46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:12:30 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[991bb78e-deb5-4ef1-8dcc-d33e2a1cb858]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG os_brick.utils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Updating existing volume attachment record: 15e78e42-8931-4be2-9615-62607cf42698 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-fcaa0055-8cae-48bd-8fc1-002fd8795538 req-07b9e894-d1a7-4b4f-bd29-6c3ddfb9ef34 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fcaa0055-8cae-48bd-8fc1-002fd8795538 req-07b9e894-d1a7-4b4f-bd29-6c3ddfb9ef34 service nova] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fcaa0055-8cae-48bd-8fc1-002fd8795538 req-07b9e894-d1a7-4b4f-bd29-6c3ddfb9ef34 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fcaa0055-8cae-48bd-8fc1-002fd8795538 req-07b9e894-d1a7-4b4f-bd29-6c3ddfb9ef34 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-fcaa0055-8cae-48bd-8fc1-002fd8795538 req-07b9e894-d1a7-4b4f-bd29-6c3ddfb9ef34 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] No waiting events found dispatching network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:30 user nova-compute[73208]: WARNING nova.compute.manager [req-fcaa0055-8cae-48bd-8fc1-002fd8795538 req-07b9e894-d1a7-4b4f-bd29-6c3ddfb9ef34 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received unexpected event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 16 09:12:34 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Port 9b934682-5a56-428d-8362-8cb499a85a94 binding to destination host user is already ACTIVE {{(pid=73208) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 09:12:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:12:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:12:34 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:12:34 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:12:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:12:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Creating tmpfile /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/tmpb7oqrfvr to verify with other compute node that the instance is on the same shared storage. {{(pid=73208) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-e0500336-9a42-4270-bae8-edf493750573 req-92e4d337-97d9-488e-b97f-59ca69518e6c service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e0500336-9a42-4270-bae8-edf493750573 req-92e4d337-97d9-488e-b97f-59ca69518e6c service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e0500336-9a42-4270-bae8-edf493750573 req-92e4d337-97d9-488e-b97f-59ca69518e6c service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e0500336-9a42-4270-bae8-edf493750573 req-92e4d337-97d9-488e-b97f-59ca69518e6c service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-e0500336-9a42-4270-bae8-edf493750573 req-92e4d337-97d9-488e-b97f-59ca69518e6c service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:35 user nova-compute[73208]: WARNING nova.compute.manager [req-e0500336-9a42-4270-bae8-edf493750573 req-92e4d337-97d9-488e-b97f-59ca69518e6c service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state resized and task_state resize_reverting.
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance destroyed successfully.
Aug 16 09:12:35 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'resources' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:11:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:11:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_vif [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b934682-5a, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:12:35 user nova-compute[73208]: INFO os_vif [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a')
Aug 16 09:12:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:35 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[85af2581-9218-42fa-bbfb-1f90924f0e02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3013735c-6821-43c7-8faa-ab15dbb6b34a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:35 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:35 user nova-compute[73208]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d027c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d283c67-b834-45ff-8cdd-3d4676d6c6ee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e56bcb-db44-4659-a0e1-459d1de76da5]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a5711f-3b11-49df-9c3a-34fbda1af7be]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:12:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a566ae9-cc1b-4a7f-af7b-daa3a03c7aa6]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9abce82-bf5d-4e1b-ac29-1ea08645608f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9d5603-3080-47f0-b55c-2852c31c8b46]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]
Aug 16 09:12:36 user nova-compute[73208]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.
Aug 16 09:12:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[420616f8-f3b2-4121-8a04-4679fe8fc9a5]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== disconnect_volume: return (298ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'migration_context' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-39739e29-490c-43a8-add0-3d4b8a5e507c req-4ccb829e-4aad-4ce4-912e-a241b1f3c0d2 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-39739e29-490c-43a8-add0-3d4b8a5e507c req-4ccb829e-4aad-4ce4-912e-a241b1f3c0d2 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-39739e29-490c-43a8-add0-3d4b8a5e507c req-4ccb829e-4aad-4ce4-912e-a241b1f3c0d2 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-39739e29-490c-43a8-add0-3d4b8a5e507c req-4ccb829e-4aad-4ce4-912e-a241b1f3c0d2 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-39739e29-490c-43a8-add0-3d4b8a5e507c req-4ccb829e-4aad-4ce4-912e-a241b1f3c0d2 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:37 user nova-compute[73208]: WARNING nova.compute.manager [req-39739e29-490c-43a8-add0-3d4b8a5e507c req-4ccb829e-4aad-4ce4-912e-a241b1f3c0d2 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state resized and task_state resize_reverting.
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.518s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:37 user nova-compute[73208]: INFO nova.compute.manager [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Swapping old allocation on dict_keys(['d9b267f9-36ef-4957-8c92-af6cce6eb509']) held by migration f70695c7-f599-43fa-a3f6-f5ae22102d99 for instance
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Overwriting current allocation {'allocations': {'d9b267f9-36ef-4957-8c92-af6cce6eb509': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 21}}, 'project_id': 'cc6f44a553f04c2288bdfa3593f90f87', 'user_id': 'e55042930262469a9989e0b9eaf44419', 'consumer_generation': 1} on consumer beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:12:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG os_brick.utils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a06af46-5b4b-4616-b26d-aa2598f3319f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[84681731-a013-4aa6-9d1b-3ca28fa35d33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd0702-8f2a-416d-b9a5-55b8c1238029]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ed22e-88c8-4868-aabc-01ba1357605a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:12:38 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:12:38 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd8d10b-838e-4979-bef5-706cc96250dc]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:12:38 user nova-compute[73208]: DEBUG os_brick.utils [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:12:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Creating image(s)
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.232s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk 1073741824" returned: 0 in 0.052s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.169s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Cannot resize image /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Ensure instance console log exists: /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Start _get_guest_xml network_info=[{"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '15e78e42-8931-4be2-9615-62607cf42698', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOxGDaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e4b82ae-cdb8-45af-b0ef-350096e7ec3e', 'attached_at': '', 'detached_at': '', 'volume_id': '613d8c6f-7e7a-49af-b022-fe8dcffc85c1', 'serial': '613d8c6f-7e7a-49af-b022-fe8dcffc85c1'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:12:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 09:12:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOxGDaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:42 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:42 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:42 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43346e9-adc0-45e2-ba52-ed027594c149]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:12:42 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff45e1-0aa8-49bc-bbad-c1292f04d6c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1] added
Aug 16 09:12:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d946a5-e49d-4933-a318-289ba8d20395]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d197c6-eb25-4d84-85aa-8f19f6d1b3bd]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrOxGDaX {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrOxGDaX" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d956c39-0442-4154-b26c-fb04a768e514]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nrOxGDaX'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1021a037-ff39-4892-b484-74ee04e66e0b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0e74d9-6888-4c24-8865-d4855afc9627]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c9e798-85b6-4114-860c-b66f58986643]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260]
Aug 16 09:12:42 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260] successful.
Aug 16 09:12:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc000cd1-39a3-4543-b10d-ff44429ae114]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2fa59b-f9d5-4618-b694-85a8c2c59ad0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:42 user nova-compute[73208]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:42 user nova-compute[73208]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c756aaa-5856-4cff-bdfe-2599d4e78638]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOxGDaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23038386238376436', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038386238376436', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-261110518',display_name='tempest-ServerActionsTestOtherA-server-184088253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-261110518',id=12,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NfBFLqJtGbvXoityJVqzPb6+0NitNd540fExHmEMlMS7yAqjRzdOfdBee660sbMv3MotVe+QM6Z8SS0UbFUtsNWJuxD1BFJ1pShsGKYPAFQnGdZtf5H8KIZhfj6YNeQ==',key_name='tempest-keypair-1107223125',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-uf33iujx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=7e4b82ae-cdb8-45af-b0ef-350096e7ec3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:12:43 user nova-compute[73208]:   <uuid>7e4b82ae-cdb8-45af-b0ef-350096e7ec3e</uuid>
Aug 16 09:12:43 user nova-compute[73208]:   <name>instance-0000000c</name>
Aug 16 09:12:43 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:12:43 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:12:43 user nova-compute[73208]:   <metadata>
Aug 16 09:12:43 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:12:43 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:12:43 user nova-compute[73208]:       <nova:name>tempest-ServerActionsTestOtherA-server-184088253</nova:name>
Aug 16 09:12:43 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:12:42</nova:creationTime>
Aug 16 09:12:43 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:12:43 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:12:43 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:12:43 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:12:43 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:12:43 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:12:43 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:12:43 user nova-compute[73208]:       <nova:owner>
Aug 16 09:12:43 user nova-compute[73208]:         <nova:user uuid="e351e35970aa48028ad400bbda5403b1">tempest-ServerActionsTestOtherA-1386845270-project-member</nova:user>
Aug 16 09:12:43 user nova-compute[73208]:         <nova:project uuid="d62017e5fe324a528f4ad1dc5c939498">tempest-ServerActionsTestOtherA-1386845270</nova:project>
Aug 16 09:12:43 user nova-compute[73208]:       </nova:owner>
Aug 16 09:12:43 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:12:43 user nova-compute[73208]:       <nova:ports>
Aug 16 09:12:43 user nova-compute[73208]:         <nova:port uuid="5ed694ee-58b8-47e6-ad9e-1e1235b94f86">
Aug 16 09:12:43 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 09:12:43 user nova-compute[73208]:         </nova:port>
Aug 16 09:12:43 user nova-compute[73208]:       </nova:ports>
Aug 16 09:12:43 user nova-compute[73208]:     </nova:instance>
Aug 16 09:12:43 user nova-compute[73208]:   </metadata>
Aug 16 09:12:43 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:12:43 user nova-compute[73208]:     <system>
Aug 16 09:12:43 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:12:43 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:12:43 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:12:43 user nova-compute[73208]:       <entry name="serial">7e4b82ae-cdb8-45af-b0ef-350096e7ec3e</entry>
Aug 16 09:12:43 user nova-compute[73208]:       <entry name="uuid">7e4b82ae-cdb8-45af-b0ef-350096e7ec3e</entry>
Aug 16 09:12:43 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:12:43 user nova-compute[73208]:     </system>
Aug 16 09:12:43 user nova-compute[73208]:   </sysinfo>
Aug 16 09:12:43 user nova-compute[73208]:   <os>
Aug 16 09:12:43 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:12:43 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:12:43 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:12:43 user nova-compute[73208]:   </os>
Aug 16 09:12:43 user nova-compute[73208]:   <features>
Aug 16 09:12:43 user nova-compute[73208]:     <acpi/>
Aug 16 09:12:43 user nova-compute[73208]:     <apic/>
Aug 16 09:12:43 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:12:43 user nova-compute[73208]:   </features>
Aug 16 09:12:43 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:12:43 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:12:43 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:12:43 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:12:43 user nova-compute[73208]:   </clock>
Aug 16 09:12:43 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:12:43 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:12:43 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:12:43 user nova-compute[73208]:   </cpu>
Aug 16 09:12:43 user nova-compute[73208]:   <devices>
Aug 16 09:12:43 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:12:43 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:12:43 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk"/>
Aug 16 09:12:43 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:12:43 user nova-compute[73208]:     </disk>
Aug 16 09:12:43 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:12:43 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:12:43 user nova-compute[73208]:       <source dev="/dev/sdc"/>
Aug 16 09:12:43 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:12:43 user nova-compute[73208]:       <serial>613d8c6f-7e7a-49af-b022-fe8dcffc85c1</serial>
Aug 16 09:12:43 user nova-compute[73208]:     </disk>
Aug 16 09:12:43 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:12:43 user nova-compute[73208]:       <mac address="fa:16:3e:ae:42:5f"/>
Aug 16 09:12:43 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:12:43 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:12:43 user nova-compute[73208]:       <target dev="tap5ed694ee-58"/>
Aug 16 09:12:43 user nova-compute[73208]:     </interface>
Aug 16 09:12:43 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:12:43 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/console.log" append="off"/>
Aug 16 09:12:43 user nova-compute[73208]:     </serial>
Aug 16 09:12:43 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:12:43 user nova-compute[73208]:     <video>
Aug 16 09:12:43 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:12:43 user nova-compute[73208]:     </video>
Aug 16 09:12:43 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:12:43 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:12:43 user nova-compute[73208]:     </rng>
Aug 16 09:12:43 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:12:43 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:12:43 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:12:43 user nova-compute[73208]:     </memballoon>
Aug 16 09:12:43 user nova-compute[73208]:   </devices>
Aug 16 09:12:43 user nova-compute[73208]: </domain>
Aug 16 09:12:43 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-261110518',display_name='tempest-ServerActionsTestOtherA-server-184088253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-261110518',id=12,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NfBFLqJtGbvXoityJVqzPb6+0NitNd540fExHmEMlMS7yAqjRzdOfdBee660sbMv3MotVe+QM6Z8SS0UbFUtsNWJuxD1BFJ1pShsGKYPAFQnGdZtf5H8KIZhfj6YNeQ==',key_name='tempest-keypair-1107223125',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-uf33iujx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=7e4b82ae-cdb8-45af-b0ef-350096e7ec3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG os_vif [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ed694ee-58, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ed694ee-58, col_values=(('external_ids', {'iface-id': '5ed694ee-58b8-47e6-ad9e-1e1235b94f86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:42:5f', 'vm-uuid': '7e4b82ae-cdb8-45af-b0ef-350096e7ec3e'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:43 user nova-compute[73208]: INFO os_vif [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58')
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No VIF found with MAC fa:16:3e:ae:42:5f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:12:43 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177148.991261, 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:12:43 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] VM Stopped (Lifecycle Event)
Aug 16 09:12:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-35f36bf2-1cdf-47f5-971e-ff687bfd512a None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-6280268c-b1d2-4b97-8535-1b3179f51ae7 req-b5cc3911-612b-4872-9a2a-a361c9c62604 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6280268c-b1d2-4b97-8535-1b3179f51ae7 req-b5cc3911-612b-4872-9a2a-a361c9c62604 service nova] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6280268c-b1d2-4b97-8535-1b3179f51ae7 req-b5cc3911-612b-4872-9a2a-a361c9c62604 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6280268c-b1d2-4b97-8535-1b3179f51ae7 req-b5cc3911-612b-4872-9a2a-a361c9c62604 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-6280268c-b1d2-4b97-8535-1b3179f51ae7 req-b5cc3911-612b-4872-9a2a-a361c9c62604 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] No waiting events found dispatching network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:45 user nova-compute[73208]: WARNING nova.compute.manager [req-6280268c-b1d2-4b97-8535-1b3179f51ae7 req-b5cc3911-612b-4872-9a2a-a361c9c62604 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received unexpected event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 09:12:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177167.2774007, 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:12:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] VM Resumed (Lifecycle Event)
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:12:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance spawned successfully.
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:12:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177167.2833228, 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:12:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] VM Started (Lifecycle Event)
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-7fa7a886-36a1-434a-919c-68970196ecda req-297b807c-7aad-4860-9344-20b1bae764a3 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7fa7a886-36a1-434a-919c-68970196ecda req-297b807c-7aad-4860-9344-20b1bae764a3 service nova] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7fa7a886-36a1-434a-919c-68970196ecda req-297b807c-7aad-4860-9344-20b1bae764a3 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7fa7a886-36a1-434a-919c-68970196ecda req-297b807c-7aad-4860-9344-20b1bae764a3 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-7fa7a886-36a1-434a-919c-68970196ecda req-297b807c-7aad-4860-9344-20b1bae764a3 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] No waiting events found dispatching network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:47 user nova-compute[73208]: WARNING nova.compute.manager [req-7fa7a886-36a1-434a-919c-68970196ecda req-297b807c-7aad-4860-9344-20b1bae764a3 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received unexpected event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 09:12:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73208) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 09:12:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f42f3459-b0a0-41ff-ab49-c262187fc68c tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.115s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Starting finish_revert_migration {{(pid=73208) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Start _get_guest_xml network_info=[{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '4e9238f1-540b-4854-9a6b-dc7a3753d441', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'beb4ea79-b782-4540-8814-09b15002b432', 'attached_at': '2023-08-16T09:12:49.000000', 'detached_at': '', 'volume_id': '9a7dc374-5cdb-4b8c-a439-828bd4f0c44c', 'serial': '9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:12:49 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:12:49 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'vcpu_model' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:49 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:49 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:49 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[651d93e3-8f7e-4fb8-8f4a-781ba4e70526]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:12:49 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ebe38-ba31-4993-99a8-b2b0790f6d3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c] added
Aug 16 09:12:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab4674-4fc5-43e5-a2d1-8db59fe23a21]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b55e9c-cc53-45ed-82ac-eea0162b85cc]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOIMXevc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOIMXevc" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bee204-059b-46ba-a54e-38769fa2e432]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zOIMXevc'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b236334e-aedb-491f-8597-33e3a82b2a2c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7abb973-73f1-423b-ad43-5e9eda0b512e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:49 user nova-compute[73208]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:49 user nova-compute[73208]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[783e9aa6-8a07-4f4c-8d68-f5d8d98a553d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]
Aug 16 09:12:49 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.
Aug 16 09:12:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b1e53b-b0ef-49c0-bc12-55b62883b766]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f7c947-a004-496f-aa1e-c305ec1fbcc6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:50 user nova-compute[73208]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:50 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:50 user nova-compute[73208]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:50 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7278e679-c1b5-4277-9ea5-755f7e77d7da]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:50 user nova-compute[73208]: INFO nova.compute.manager [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Detaching volume 20d34247-87f5-4a67-a19f-15f07e34e384
Aug 16 09:12:50 user nova-compute[73208]: INFO nova.virt.block_device [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Attempting to driver detach volume 20d34247-87f5-4a67-a19f-15f07e34e384 from mountpoint /dev/vdb
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Attempting to detach device vdb from instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:12:50 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:12:50 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:12:50 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:12:50 user nova-compute[73208]:   <serial>20d34247-87f5-4a67-a19f-15f07e34e384</serial>
Aug 16 09:12:50 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 09:12:50 user nova-compute[73208]: </disk>
Aug 16 09:12:50 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:12:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully detached device vdb from instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e from the persistent domain config.
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:12:50 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:12:50 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:12:50 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:12:50 user nova-compute[73208]:   <serial>20d34247-87f5-4a67-a19f-15f07e34e384</serial>
Aug 16 09:12:50 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 09:12:50 user nova-compute[73208]: </disk>
Aug 16 09:12:50 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177155.7719657, beb4ea79-b782-4540-8814-09b15002b432 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:12:50 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Stopped (Lifecycle Event)
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177170.777109, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:12:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully detached device vdb from instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e from the live domain config.
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Iifrawxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:50 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:12:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:12:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ed2498ff-45f5-4ac2-a3be-6aacd19f1178 None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26337663336363830', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337663336363830', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.283s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf6bcd0-edf8-4a40-9af0-7e6ccfdb7cb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:11:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:12:51 user nova-compute[73208]:   <uuid>beb4ea79-b782-4540-8814-09b15002b432</uuid>
Aug 16 09:12:51 user nova-compute[73208]:   <name>instance-00000004</name>
Aug 16 09:12:51 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:12:51 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:12:51 user nova-compute[73208]:   <metadata>
Aug 16 09:12:51 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:12:51 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:12:51 user nova-compute[73208]:       <nova:name>tempest-ServerActionsTestOtherB-server-516370955</nova:name>
Aug 16 09:12:51 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:12:49</nova:creationTime>
Aug 16 09:12:51 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:12:51 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:12:51 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:12:51 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:12:51 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:12:51 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:12:51 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:12:51 user nova-compute[73208]:       <nova:owner>
Aug 16 09:12:51 user nova-compute[73208]:         <nova:user uuid="e55042930262469a9989e0b9eaf44419">tempest-ServerActionsTestOtherB-1962627754-project-member</nova:user>
Aug 16 09:12:51 user nova-compute[73208]:         <nova:project uuid="cc6f44a553f04c2288bdfa3593f90f87">tempest-ServerActionsTestOtherB-1962627754</nova:project>
Aug 16 09:12:51 user nova-compute[73208]:       </nova:owner>
Aug 16 09:12:51 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:12:51 user nova-compute[73208]:       <nova:ports>
Aug 16 09:12:51 user nova-compute[73208]:         <nova:port uuid="9b934682-5a56-428d-8362-8cb499a85a94">
Aug 16 09:12:51 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 09:12:51 user nova-compute[73208]:         </nova:port>
Aug 16 09:12:51 user nova-compute[73208]:       </nova:ports>
Aug 16 09:12:51 user nova-compute[73208]:     </nova:instance>
Aug 16 09:12:51 user nova-compute[73208]:   </metadata>
Aug 16 09:12:51 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:12:51 user nova-compute[73208]:     <system>
Aug 16 09:12:51 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:12:51 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:12:51 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:12:51 user nova-compute[73208]:       <entry name="serial">beb4ea79-b782-4540-8814-09b15002b432</entry>
Aug 16 09:12:51 user nova-compute[73208]:       <entry name="uuid">beb4ea79-b782-4540-8814-09b15002b432</entry>
Aug 16 09:12:51 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:12:51 user nova-compute[73208]:     </system>
Aug 16 09:12:51 user nova-compute[73208]:   </sysinfo>
Aug 16 09:12:51 user nova-compute[73208]:   <os>
Aug 16 09:12:51 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:12:51 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:12:51 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:12:51 user nova-compute[73208]:   </os>
Aug 16 09:12:51 user nova-compute[73208]:   <features>
Aug 16 09:12:51 user nova-compute[73208]:     <acpi/>
Aug 16 09:12:51 user nova-compute[73208]:     <apic/>
Aug 16 09:12:51 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:12:51 user nova-compute[73208]:   </features>
Aug 16 09:12:51 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:12:51 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:12:51 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:12:51 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:12:51 user nova-compute[73208]:   </clock>
Aug 16 09:12:51 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:12:51 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:12:51 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:12:51 user nova-compute[73208]:   </cpu>
Aug 16 09:12:51 user nova-compute[73208]:   <devices>
Aug 16 09:12:51 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:12:51 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:12:51 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk"/>
Aug 16 09:12:51 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:12:51 user nova-compute[73208]:     </disk>
Aug 16 09:12:51 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:12:51 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:12:51 user nova-compute[73208]:       <source dev="/dev/sdd"/>
Aug 16 09:12:51 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:12:51 user nova-compute[73208]:       <serial>9a7dc374-5cdb-4b8c-a439-828bd4f0c44c</serial>
Aug 16 09:12:51 user nova-compute[73208]:     </disk>
Aug 16 09:12:51 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:12:51 user nova-compute[73208]:       <mac address="fa:16:3e:e0:7b:07"/>
Aug 16 09:12:51 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:12:51 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:12:51 user nova-compute[73208]:       <target dev="tap9b934682-5a"/>
Aug 16 09:12:51 user nova-compute[73208]:     </interface>
Aug 16 09:12:51 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:12:51 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/console.log" append="off"/>
Aug 16 09:12:51 user nova-compute[73208]:     </serial>
Aug 16 09:12:51 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:12:51 user nova-compute[73208]:     <video>
Aug 16 09:12:51 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:12:51 user nova-compute[73208]:     </video>
Aug 16 09:12:51 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:12:51 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:12:51 user nova-compute[73208]:     </rng>
Aug 16 09:12:51 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:12:51 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:12:51 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:12:51 user nova-compute[73208]:     </memballoon>
Aug 16 09:12:51 user nova-compute[73208]:   </devices>
Aug 16 09:12:51 user nova-compute[73208]: </domain>
Aug 16 09:12:51 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:11:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_vif [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29991a9-36d9-45fe-90d2-0c294458053a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:51 user nova-compute[73208]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:51 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 (non-flash)
Aug 16 09:12:51 user nova-compute[73208]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:12:51 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:12:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d027dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b934682-5a, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b934682-5a, col_values=(('external_ids', {'iface-id': '9b934682-5a56-428d-8362-8cb499a85a94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:7b:07', 'vm-uuid': 'beb4ea79-b782-4540-8814-09b15002b432'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:51 user nova-compute[73208]: INFO os_vif [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a')
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[424c42b7-a1a0-47f2-b524-0ba9d07df7f3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace2c33-eba6-4e33-b5b7-6d168e258342]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c09a55b-492c-441f-ab74-e854c3528702]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a1b903-b59c-4d58-a7ba-e53a20af4699]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[160baecd-f93d-45ea-b795-ec54549ede1b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30a7779-7aa2-4756-b5a4-d97540c25f5e]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260]
Aug 16 09:12:51 user nova-compute[73208]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384, portal: 172.16.0.220,3260] successful.
Aug 16 09:12:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d34247-87f5-4a67-a19f-15f07e34e384 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c887805-1afe-4620-88db-390dc826b89e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== disconnect_volume: return (589ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-302e8be0-fbef-4bae-829a-d2b70c40af7c req-93ac3e33-8ddb-42f1-9888-17cc24a6c716 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received event network-changed-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-302e8be0-fbef-4bae-829a-d2b70c40af7c req-93ac3e33-8ddb-42f1-9888-17cc24a6c716 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Refreshing instance network info cache due to event network-changed-87fdcd87-2939-41c6-9451-f9afe4d0f63a. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-302e8be0-fbef-4bae-829a-d2b70c40af7c req-93ac3e33-8ddb-42f1-9888-17cc24a6c716 service nova] Acquiring lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-302e8be0-fbef-4bae-829a-d2b70c40af7c req-93ac3e33-8ddb-42f1-9888-17cc24a6c716 service nova] Acquired lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-302e8be0-fbef-4bae-829a-d2b70c40af7c req-93ac3e33-8ddb-42f1-9888-17cc24a6c716 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Refreshing network info cache for port 87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-68e35879-153c-4219-a191-6fa0ed22cd9e tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.162s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lazy-loading 'flavor' on Instance uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9b79de2a-e5a3-49b6-9c63-2d53a876300d tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9b79de2a-e5a3-49b6-9c63-2d53a876300d tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9b79de2a-e5a3-49b6-9c63-2d53a876300d tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9b79de2a-e5a3-49b6-9c63-2d53a876300d tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73208) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-9b79de2a-e5a3-49b6-9c63-2d53a876300d tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:52 user nova-compute[73208]: INFO nova.compute.manager [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Attaching volume 757a51cc-564d-4deb-bd57-d43321e44f2f to /dev/vdb
Aug 16 09:12:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG os_brick.utils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[394e38ab-785c-4d72-810f-90b2d6d4d78a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4042c6c2-a38a-44e0-b711-9a98eb2c7ee2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d853f04-4fdc-4e6c-a4ca-f04fdbd2362b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fb6f6f-e68b-419a-afa2-7a3b0fa11721]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:12:52 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:12:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3bb6a2-809f-4341-8116-b5b640d9c881]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG os_brick.utils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:12:52 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Updating existing volume attachment record: 45ec1d99-6b28-4950-bb7d-c7f85683540a {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG nova.network.neutron [req-302e8be0-fbef-4bae-829a-d2b70c40af7c req-93ac3e33-8ddb-42f1-9888-17cc24a6c716 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Updated VIF entry in instance network info cache for port 87fdcd87-2939-41c6-9451-f9afe4d0f63a. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG nova.network.neutron [req-302e8be0-fbef-4bae-829a-d2b70c40af7c req-93ac3e33-8ddb-42f1-9888-17cc24a6c716 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Updating instance_info_cache with network_info: [{"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-302e8be0-fbef-4bae-829a-d2b70c40af7c req-93ac3e33-8ddb-42f1-9888-17cc24a6c716 service nova] Releasing lock "refresh_cache-650ba2c3-c61c-438b-8f87-79d5a98c078a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-70957ce5-56a5-48ac-a8ac-6dbc3801461d req-20bf6ae5-3e6e-4d5d-98db-425781a65dc3 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-70957ce5-56a5-48ac-a8ac-6dbc3801461d req-20bf6ae5-3e6e-4d5d-98db-425781a65dc3 service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-70957ce5-56a5-48ac-a8ac-6dbc3801461d req-20bf6ae5-3e6e-4d5d-98db-425781a65dc3 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-70957ce5-56a5-48ac-a8ac-6dbc3801461d req-20bf6ae5-3e6e-4d5d-98db-425781a65dc3 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-70957ce5-56a5-48ac-a8ac-6dbc3801461d req-20bf6ae5-3e6e-4d5d-98db-425781a65dc3 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:53 user nova-compute[73208]: WARNING nova.compute.manager [req-70957ce5-56a5-48ac-a8ac-6dbc3801461d req-20bf6ae5-3e6e-4d5d-98db-425781a65dc3 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state active and task_state powering-off.
Aug 16 09:12:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:53 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance destroyed successfully.
Aug 16 09:12:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9b79de2a-e5a3-49b6-9c63-2d53a876300d tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9b79de2a-e5a3-49b6-9c63-2d53a876300d tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.030s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:54 user nova-compute[73208]: WARNING nova.compute.manager [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state resized and task_state resize_reverting.
Aug 16 09:12:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:54 user nova-compute[73208]: WARNING nova.compute.manager [req-b2b7d749-e64a-4028-a646-11722b7541a6 req-a4e10a39-a89f-451c-84ac-ca31048617aa service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state resized and task_state resize_reverting.
Aug 16 09:12:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-b78b051d-a6bd-474f-95cb-267a52c99f79 req-c216730e-caca-4393-9fea-f87f8b3e3b18 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:12:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b78b051d-a6bd-474f-95cb-267a52c99f79 req-c216730e-caca-4393-9fea-f87f8b3e3b18 service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:12:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b78b051d-a6bd-474f-95cb-267a52c99f79 req-c216730e-caca-4393-9fea-f87f8b3e3b18 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:12:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b78b051d-a6bd-474f-95cb-267a52c99f79 req-c216730e-caca-4393-9fea-f87f8b3e3b18 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-b78b051d-a6bd-474f-95cb-267a52c99f79 req-c216730e-caca-4393-9fea-f87f8b3e3b18 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:12:55 user nova-compute[73208]: WARNING nova.compute.manager [req-b78b051d-a6bd-474f-95cb-267a52c99f79 req-c216730e-caca-4393-9fea-f87f8b3e3b18 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state stopped and task_state None.
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177175.433842, beb4ea79-b782-4540-8814-09b15002b432 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:12:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Resumed (Lifecycle Event)
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:12:55 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance running successfully.
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] finish_revert_migration finished successfully. {{(pid=73208) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:12:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177175.4384763, beb4ea79-b782-4540-8814-09b15002b432 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:12:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Started (Lifecycle Event)
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:12:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:12:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 09:12:55 user nova-compute[73208]: INFO nova.compute.manager [None req-6cc3795a-d85a-454e-804b-02f03469c40a tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance to original state: 'active'
Aug 16 09:12:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:12:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:03 user nova-compute[73208]: INFO nova.compute.manager [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Terminating instance
Aug 16 09:13:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:03 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:03 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:03 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:03 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:03 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:03 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:13:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[13079d15-81d4-4fb1-b14f-78f5f51b9b9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:13:04 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[da94ce21-051d-4b00-bb88-825e9af62689]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f] added
Aug 16 09:13:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f7ae9-4323-4956-872b-c39befa3da24]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d2dfee-43c7-4d1a-ab43-ec361041bd25]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IticZwPd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IticZwPd" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[824ae6a9-d7d4-4519-81be-fa2300d6f8db]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IticZwPd'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-03b3e109-af41-4591-a1c7-97248953c120 req-f6e1b7c9-06cb-404f-adaa-bd342e9d2630 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-unplugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-03b3e109-af41-4591-a1c7-97248953c120 req-f6e1b7c9-06cb-404f-adaa-bd342e9d2630 service nova] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-03b3e109-af41-4591-a1c7-97248953c120 req-f6e1b7c9-06cb-404f-adaa-bd342e9d2630 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-03b3e109-af41-4591-a1c7-97248953c120 req-f6e1b7c9-06cb-404f-adaa-bd342e9d2630 service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-03b3e109-af41-4591-a1c7-97248953c120 req-f6e1b7c9-06cb-404f-adaa-bd342e9d2630 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] No waiting events found dispatching network-vif-unplugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-03b3e109-af41-4591-a1c7-97248953c120 req-f6e1b7c9-06cb-404f-adaa-bd342e9d2630 service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-unplugged-0bbaa277-2952-499a-9b56-e0dc09d81095 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4753f6db-5532-43ec-a666-83c156ed76e6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f088cf0-b3c5-4261-b68d-15fd5a4f3103]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:04 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:04 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --login" returned: 0 in 0.160s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[049e274b-0f01-4432-92eb-a3dec9d17b13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260]
Aug 16 09:13:04 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e075bf32-81f5-4ad5-972a-f2caac7cbd91]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedce071-a00b-4c68-9d49-de3350a7371b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:04 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:04 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:04 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:04 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[150ed147-4e26-424e-a2d7-454ef6583b32]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:13:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Instance destroyed successfully.
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'resources' on Instance uuid 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-86453005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-86453005',id=2,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvQS8OkM6GCnnBI8vpSyzDNIWEWgT4Zn8HYodhu7szkC4i1yM7sLrd6tfpdIyvnrxwRg48+yftTDYkD1C5MKrNOy2sRzTHbubhSOoRIp/Sb2Lh31W/68eSiGtoRtQKFSg==',key_name='tempest-keypair-1433315580',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:10:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-22bku0a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b78d27e-d22f-45a7-8fd4-0d0366fd68ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "0bbaa277-2952-499a-9b56-e0dc09d81095", "address": "fa:16:3e:8d:02:a6", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbaa277-29", "ovs_interfaceid": "0bbaa277-2952-499a-9b56-e0dc09d81095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG os_vif [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bbaa277-29, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:05 user nova-compute[73208]: INFO os_vif [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=0bbaa277-2952-499a-9b56-e0dc09d81095,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbaa277-29')
Aug 16 09:13:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Deleting instance files /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad_del
Aug 16 09:13:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Deletion of /opt/stack/data/nova/instances/8b78d27e-d22f-45a7-8fd4-0d0366fd68ad_del complete
Aug 16 09:13:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:05 user nova-compute[73208]: INFO nova.compute.manager [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 16 09:13:05 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26538346566386338', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538346566386338', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.objects.instance [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lazy-loading 'flavor' on Instance uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:13:05 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:13:05 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:13:05 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:13:05 user nova-compute[73208]:   <serial>757a51cc-564d-4deb-bd57-d43321e44f2f</serial>
Aug 16 09:13:05 user nova-compute[73208]: </disk>
Aug 16 09:13:05 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-21c20069-175f-4441-9a1c-7ef581808eda req-da90ae7b-ca03-4b4d-a0bd-0ab21337b31e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-deleted-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:13:05 user nova-compute[73208]: INFO nova.compute.manager [req-21c20069-175f-4441-9a1c-7ef581808eda req-da90ae7b-ca03-4b4d-a0bd-0ab21337b31e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Neutron deleted interface 0bbaa277-2952-499a-9b56-e0dc09d81095; detaching it from the instance and deleting it from the info cache
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-21c20069-175f-4441-9a1c-7ef581808eda req-da90ae7b-ca03-4b4d-a0bd-0ab21337b31e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:13:05 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Took 1.05 seconds to deallocate network for instance.
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-21c20069-175f-4441-9a1c-7ef581808eda req-da90ae7b-ca03-4b4d-a0bd-0ab21337b31e service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Detach interface failed, port_id=0bbaa277-2952-499a-9b56-e0dc09d81095, reason: Instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-52ad5b86-19a2-403f-90c2-5db3557b1578 req-b5e256a1-cb34-4b51-9d8a-cdc3c8a94529 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received event network-changed-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-52ad5b86-19a2-403f-90c2-5db3557b1578 req-b5e256a1-cb34-4b51-9d8a-cdc3c8a94529 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Refreshing instance network info cache due to event network-changed-8225a859-e184-4a24-a5be-864093af543b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-52ad5b86-19a2-403f-90c2-5db3557b1578 req-b5e256a1-cb34-4b51-9d8a-cdc3c8a94529 service nova] Acquiring lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-52ad5b86-19a2-403f-90c2-5db3557b1578 req-b5e256a1-cb34-4b51-9d8a-cdc3c8a94529 service nova] Acquired lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-52ad5b86-19a2-403f-90c2-5db3557b1578 req-b5e256a1-cb34-4b51-9d8a-cdc3c8a94529 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Refreshing network info cache for port 8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:13:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] No VIF found with MAC fa:16:3e:1d:9a:a8, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-41b72525-ad00-4230-91d0-a699e019acaf tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.577s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-7d06d60e-7c42-4ce5-975c-0601d4c25f8b req-9905929b-c92b-4b76-8fd8-50693e3bb01c service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7d06d60e-7c42-4ce5-975c-0601d4c25f8b req-9905929b-c92b-4b76-8fd8-50693e3bb01c service nova] Acquiring lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7d06d60e-7c42-4ce5-975c-0601d4c25f8b req-9905929b-c92b-4b76-8fd8-50693e3bb01c service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7d06d60e-7c42-4ce5-975c-0601d4c25f8b req-9905929b-c92b-4b76-8fd8-50693e3bb01c service nova] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-7d06d60e-7c42-4ce5-975c-0601d4c25f8b req-9905929b-c92b-4b76-8fd8-50693e3bb01c service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] No waiting events found dispatching network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:13:06 user nova-compute[73208]: WARNING nova.compute.manager [req-7d06d60e-7c42-4ce5-975c-0601d4c25f8b req-9905929b-c92b-4b76-8fd8-50693e3bb01c service nova] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Received unexpected event network-vif-plugged-0bbaa277-2952-499a-9b56-e0dc09d81095 for instance with vm_state deleted and task_state None.
Aug 16 09:13:06 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:06 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Deleted allocations for instance 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad
Aug 16 09:13:06 user nova-compute[73208]: DEBUG nova.network.neutron [req-52ad5b86-19a2-403f-90c2-5db3557b1578 req-b5e256a1-cb34-4b51-9d8a-cdc3c8a94529 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updated VIF entry in instance network info cache for port 8225a859-e184-4a24-a5be-864093af543b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG nova.network.neutron [req-52ad5b86-19a2-403f-90c2-5db3557b1578 req-b5e256a1-cb34-4b51-9d8a-cdc3c8a94529 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updating instance_info_cache with network_info: [{"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-52ad5b86-19a2-403f-90c2-5db3557b1578 req-b5e256a1-cb34-4b51-9d8a-cdc3c8a94529 service nova] Releasing lock "refresh_cache-866a499a-2f3f-4922-baf8-4aa0f821817b" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4869a072-191e-4a1a-b3cb-5f1bc516474f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b78d27e-d22f-45a7-8fd4-0d0366fd68ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.868s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG nova.objects.instance [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'flavor' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:06 user nova-compute[73208]: INFO nova.compute.manager [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Attaching volume 0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 to /dev/vdb
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.utils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f738d2a9-9981-4ebf-8253-d2f63e900856]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf15b124-c73c-428e-bdba-a4f7e6f25e46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4399911e-fb75-4d63-bb9e-83c2e8054721]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31e3df-8c8f-4a7c-baad-05593e3c1714]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:07 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a4bf36-a571-4a46-a894-305abeba36ff]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.utils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updating existing volume attachment record: 21d5c1aa-fc28-49a6-b077-96881cca92c4 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.utils [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29bf15c-26c8-4122-b206-ebafd1cc0793]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7997fd-9da2-4214-89cc-e35ec7f3fb67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c9da83-7e66-45a3-9e1c-b28732da58e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5175a8b9-2da3-4000-8121-e0568af13370]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:07 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:13:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[37df5896-0f8f-4572-ae8e-08758fe1dff8]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:13:07 user nova-compute[73208]: DEBUG os_brick.utils [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:07 user nova-compute[73208]: INFO nova.compute.manager [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Swapping volume 757a51cc-564d-4deb-bd57-d43321e44f2f for f3d87c71-d765-4e72-8693-4294950e115c
Aug 16 09:13:08 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177173.3983634, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:13:08 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Stopped (Lifecycle Event)
Aug 16 09:13:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3fd3d9ef-8a59-4b8a-95df-d08a3e25f10e None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:13:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3fd3d9ef-8a59-4b8a-95df-d08a3e25f10e None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:13:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmWsFGCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:17 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:17 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:17 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad270da2-4809-4a6f-b681-f73e039ac054]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:13:17 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[421c1a6b-e40d-41f4-aa4d-f4d45b25c047]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13] added
Aug 16 09:13:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a8f710-6136-4b26-9114-6ee63808fe0b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd870f0b-db0c-4671-b2a5-1a2a0963f5c9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BmWsFGCk {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BmWsFGCk" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3ffcd5-2b18-4c13-af7b-e2173bdf6e3e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BmWsFGCk'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6f7d6b-5965-491a-8ea2-f67078369f0a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f56a67-befc-43af-9f1b-5f878b58e9df]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:18 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:18 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aadb8e-0aca-478b-9667-f5594a2d5921]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13, portal: 172.16.0.220,3260]
Aug 16 09:13:18 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:18 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fe1ccd-e66f-4a78-987c-3e177d79b640]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8577cb2c-e5cd-488b-aa8d-687b6c6c198b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:18 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:18 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:18 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a4e577-c725-4484-b89e-d7e3d9a4176a]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmWsFGCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbuqViv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '650ba2c3-c61c-438b-8f87-79d5a98c078a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3d87c71-d765-4e72-8693-4294950e115c', 'serial': 'f3d87c71-d765-4e72-8693-4294950e115c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '650ba2c3-c61c-438b-8f87-79d5a98c078a', 'attached_at': '', 'detached_at': '', 'volume_id': '757a51cc-564d-4deb-bd57-d43321e44f2f', 'serial'} {{(pid=73208) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbuqViv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:18 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23561353731336338', 'path': '/dev/sde'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561353731336338', 'path': '/dev/sde'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.460s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:19 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.054s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:19 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.objects.instance [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'flavor' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe2cd9f-268f-44b3-829b-d8b61c48b46f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:13:19 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56e4631-02d8-4132-aee3-4edc3432791f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c] added
Aug 16 09:13:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:13:19 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:13:19 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:13:19 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:13:19 user nova-compute[73208]:   <serial>0d85afed-c2ff-4cc5-be8d-de7f63d3ac13</serial>
Aug 16 09:13:19 user nova-compute[73208]: </disk>
Aug 16 09:13:19 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89b9f42-5bba-4b3f-84b5-11985065a301]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fd11b1-c176-4bc2-8bd8-c3170ed921f3]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBbuqViv {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBbuqViv" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcdc1ee-3926-4fbc-8fad-6d6621660450]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBbuqViv'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df68b03-628d-45f7-a7cc-42496fdb3a1a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177184.5756443, 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:13:19 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] VM Stopped (Lifecycle Event)
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2e9415-7a42-4943-9b54-a1e318c46f52]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dbdd5b97-bb7c-41d5-bc2b-c92c2f15f6a3 None None] [instance: 8b78d27e-d22f-45a7-8fd4-0d0366fd68ad] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14fe32-9344-412c-a140-1393c29ed287]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c, portal: 172.16.0.220,3260]
Aug 16 09:13:19 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e331c8-fa15-4827-b69e-457aa79fa859]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3254149b-4f5f-4f56-b3d6-474909dd7664]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:19 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:19 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b901a-9d7d-404c-8cfb-e310f4b88d32]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbuqViv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:13:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No VIF found with MAC fa:16:3e:6f:ad:94, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5b234192-52f8-4a8f-806f-a928d9356059 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.086s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.774s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] <== connect_volume: return (2235ms) {'type': 'block', 'scsi_wwn': '23963356562333636', 'path': '/dev/sdf'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963356562333636', 'path': '/dev/sdf'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:13:21 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:13:21 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=25.695755004882812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.objects.instance [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lazy-loading 'flavor' on Instance uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 650ba2c3-c61c-438b-8f87-79d5a98c078a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 866a499a-2f3f-4922-baf8-4aa0f821817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 111149056 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 267386880 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 397410304 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid aeff110f-8cbd-480d-8654-b0daee121eb7 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 552599552 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 685768704 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 832569344 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'flavor' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:24 user nova-compute[73208]: INFO nova.compute.manager [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Attaching volume e554115c-ea48-4c56-8574-fe795e86f026 to /dev/vdc
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.utils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[762a5b52-5632-417c-a406-342d54ad831a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f76a11-d871-454b-a377-cdc9bf0ccfde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[71218d75-7d93-4194-8210-486e00f02078]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513ea72-fa36-431b-a050-f032472f6476]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 987758592 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:25 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b8d78c-f39a-4e43-9436-42b3a18a4186]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.utils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updating existing volume attachment record: 64789a64-6b5b-4f92-b460-9325e7bae57a {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:25 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83d980-6a3c-42b9-9802-ea131239af25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4554c8c-a041-4b04-b70a-110a08d01e95]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:25 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:25 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:25 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:25 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:25 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:25 user nova-compute[73208]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:25 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:25 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d027c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a27a7a-ad03-4a2e-8924-f50c530c9b4f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0008c12d-ea77-49b7-b4e9-c4cbbf500973]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3569ad6-6b05-4bfa-851d-f49466180f29]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd824180-83f3-4cb7-9e0d-3f1c202a75d0]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[147fbaf9-19d9-45ff-bb67-09e413f98eef]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5ecb40-7d8e-4872-b3be-4c2132b0d7a2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260]
Aug 16 09:13:26 user nova-compute[73208]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8832b5-955a-4ebd-9a96-de76a083751d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] <== disconnect_volume: return (299ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbuqViv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '650ba2c3-c61c-438b-8f87-79d5a98c078a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3d87c71-d765-4e72-8693-4294950e115c', 'serial'} {{(pid=73208) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 09:13:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] swap_volume: removing Cinder connection for volume 757a51cc-564d-4deb-bd57-d43321e44f2f {{(pid=73208) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 09:13:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] swap_volume: Updating volume 757a51cc-564d-4deb-bd57-d43321e44f2f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "xBbuqViv", "auth_password": "82ut5nlMyAF9rf", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "f3d87c71-d765-4e72-8693-4294950e115c"}, "status": "reserved", "instance": "650ba2c3-c61c-438b-8f87-79d5a98c078a", "attached_at": "", "detached_at": "", "volume_id": "f3d87c71-d765-4e72-8693-4294950e115c", "serial": "f3d87c71-d765-4e72-8693-4294950e115c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f3d87c71-d765-4e72-8693-4294950e115c', 'no_device': None, 'attachment_id': '4de50e6a-fcda-4bc9-9b60-bc98db3b15de'} {{(pid=73208) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 09:13:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e7db03dd-5271-467e-b59b-514f9f517e42 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.743s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG os_brick.utils [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d13d8-9ea1-4039-9937-1603c7c4a336]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cb59bd-1be2-40b7-bb24-5c94f9c94fbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1c53d-b688-4333-b885-f10fd3306896]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce7e5ba-14e5-4228-891c-7f6c101e48b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:28 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:13:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[df81d88a-f727-4d3d-9491-bc9b8f92c3fd]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:13:28 user nova-compute[73208]: DEBUG os_brick.utils [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:28 user nova-compute[73208]: INFO nova.compute.manager [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Swapping volume f3d87c71-d765-4e72-8693-4294950e115c for 757a51cc-564d-4deb-bd57-d43321e44f2f
Aug 16 09:13:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:13:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:13:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:13:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:13:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHvrcblJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:36 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:36 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:36 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed759539-c28e-4f60-94bc-39698696cae9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:13:36 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[267144eb-34c8-46ba-8854-1847774c5b0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026] added
Aug 16 09:13:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1752e-23a1-45ec-93b8-f9fece9cc48c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f30edd-d117-44ce-81fb-fcb77f252cf4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHvrcblJ {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHvrcblJ" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[442b36d0-ee6c-4fb8-845d-cfd4c0de33b4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NHvrcblJ'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9794afb6-6ef1-4ca0-ad26-95c2bc5f7d4f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdee6c2-8418-45d4-88e4-091b4edf4c34]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:36 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:36 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:36 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:36 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:36 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:36 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b212a40-378e-447e-9440-0d8c176bb8df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026, portal: 172.16.0.220,3260]
Aug 16 09:13:37 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:37 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7428caa-9dc6-4430-803f-8991e80dfff5]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5a2c02-0bea-4a31-9983-706e29f79566]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:37 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:37 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:37 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:37 user nova-compute[73208]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)
Aug 16 09:13:37 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:37 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:37 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:37 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:37 user nova-compute[73208]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)
Aug 16 09:13:37 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b59f5-9e97-4d6b-8482-e4cce00b811e]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHvrcblJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26661326564313666', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661326564313666', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG nova.objects.instance [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'flavor' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:13:38 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:13:38 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:13:38 user nova-compute[73208]:   <target dev="vdc" bus="virtio"/>
Aug 16 09:13:38 user nova-compute[73208]:   <serial>e554115c-ea48-4c56-8574-fe795e86f026</serial>
Aug 16 09:13:38 user nova-compute[73208]: </disk>
Aug 16 09:13:38 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] No VIF found with MAC fa:16:3e:6f:ad:94, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:13:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9d59dca9-ec96-4167-95fd-8e3feab5de57 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.857s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:39 user nova-compute[73208]: INFO nova.compute.manager [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Detaching volume e554115c-ea48-4c56-8574-fe795e86f026
Aug 16 09:13:39 user nova-compute[73208]: INFO nova.virt.block_device [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Attempting to driver detach volume e554115c-ea48-4c56-8574-fe795e86f026 from mountpoint /dev/vdc
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Attempting to detach device vdc from instance 866a499a-2f3f-4922-baf8-4aa0f821817b from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:13:39 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:13:39 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:13:39 user nova-compute[73208]:   <target dev="vdc" bus="virtio"/>
Aug 16 09:13:39 user nova-compute[73208]:   <serial>e554115c-ea48-4c56-8574-fe795e86f026</serial>
Aug 16 09:13:39 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 09:13:39 user nova-compute[73208]: </disk>
Aug 16 09:13:39 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:13:39 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Successfully detached device vdc from instance 866a499a-2f3f-4922-baf8-4aa0f821817b from the persistent domain config.
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 866a499a-2f3f-4922-baf8-4aa0f821817b from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:13:39 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:13:39 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:13:39 user nova-compute[73208]:   <target dev="vdc" bus="virtio"/>
Aug 16 09:13:39 user nova-compute[73208]:   <serial>e554115c-ea48-4c56-8574-fe795e86f026</serial>
Aug 16 09:13:39 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 09:13:39 user nova-compute[73208]: </disk>
Aug 16 09:13:39 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-3f6eb823-28e8-4a7f-8025-9a0e7538c3a3 req-978552fc-cdde-4925-8cc8-9f342b818732 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received event network-changed-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-3f6eb823-28e8-4a7f-8025-9a0e7538c3a3 req-978552fc-cdde-4925-8cc8-9f342b818732 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Refreshing instance network info cache due to event network-changed-4fb59cce-601d-4b87-870f-116f52b38065. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3f6eb823-28e8-4a7f-8025-9a0e7538c3a3 req-978552fc-cdde-4925-8cc8-9f342b818732 service nova] Acquiring lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3f6eb823-28e8-4a7f-8025-9a0e7538c3a3 req-978552fc-cdde-4925-8cc8-9f342b818732 service nova] Acquired lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-3f6eb823-28e8-4a7f-8025-9a0e7538c3a3 req-978552fc-cdde-4925-8cc8-9f342b818732 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Refreshing network info cache for port 4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '650ba2c3-c61c-438b-8f87-79d5a98c078a', 'attached_at': '', 'detached_at': '', 'volume_id': '757a51cc-564d-4deb-bd57-d43321e44f2f', 'serial': '757a51cc-564d-4deb-bd57-d43321e44f2f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbuqViv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'f3d87c71-d765-4e72-8693-4294950e115c'}, 'status': 'reserved', 'instance': '650ba2c3-c61c-438b-8f87-79d5a98c078a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3d87c71-d765-4e72-8693-4294950e115c', 'serial'} {{(pid=73208) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:39 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:39 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:39 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f166be9d-53f3-46eb-a7e1-65e8b4f99863]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:13:39 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[77835b84-696c-45f2-92da-135638e10b95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f] added
Aug 16 09:13:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a558346-0548-4544-9d7b-17e7e91a6ac8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c96a7a9-a66c-40dc-af02-f9580323f302]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IticZwPd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IticZwPd" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a2b61-81d6-4928-a66a-fb4529a1cd52]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IticZwPd'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad9f964-ac85-475f-a30c-a51a598c324f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc33bee3-fe33-4d8e-b319-32ccddd492e5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3101e72-69df-46d5-a0a8-154280d1a536]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260]
Aug 16 09:13:39 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177219.9065194, 866a499a-2f3f-4922-baf8-4aa0f821817b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:13:39 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Successfully detached device vdc from instance 866a499a-2f3f-4922-baf8-4aa0f821817b from the live domain config.
Aug 16 09:13:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHvrcblJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:39 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c7deb4-34f6-4eaa-ab16-3e0cff09a036]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ed23f4-4ba6-4dd6-af6a-53676bc1c599]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)
Aug 16 09:13:39 user nova-compute[73208]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d982c92-9434-4207-8d1d-a1a69120bc53]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:13:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-3f6eb823-28e8-4a7f-8025-9a0e7538c3a3 req-978552fc-cdde-4925-8cc8-9f342b818732 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updated VIF entry in instance network info cache for port 4fb59cce-601d-4b87-870f-116f52b38065. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:13:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-3f6eb823-28e8-4a7f-8025-9a0e7538c3a3 req-978552fc-cdde-4925-8cc8-9f342b818732 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updating instance_info_cache with network_info: [{"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:13:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3f6eb823-28e8-4a7f-8025-9a0e7538c3a3 req-978552fc-cdde-4925-8cc8-9f342b818732 service nova] Releasing lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26538346566386338', 'path': '/dev/sdg'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538346566386338', 'path': '/dev/sdg'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.082s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lazy-loading 'flavor' on Instance uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e6b71d-8c2a-4b89-b927-dfce28508cc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbe5b8c-ddb5-4ab5-a275-9f38a9d0719b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 (non-flash)
Aug 16 09:13:41 user nova-compute[73208]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d074ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2587ba-85d1-479e-8617-eb9a80f9cc6a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6279de-c7f7-48dc-93bc-65f82166d0a0]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db9fb1-5ca5-4877-bb10-da206b516528]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4794eeef-2a85-440d-a605-a11b399fe1de]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9900a15-57c9-4069-8be6-be3b747cc3f5]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcc32ca-2ae5-4707-8f90-60161bbfb08b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026, portal: 172.16.0.220,3260]
Aug 16 09:13:41 user nova-compute[73208]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e554115c-ea48-4c56-8574-fe795e86f026 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f5d5c6-7fa9-44d2-b52a-ac683c5e7e92]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] <== disconnect_volume: return (1384ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 70254592 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:42 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'flavor' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3851bbd5-f5cd-41e0-8ea4-183eb76d9cd2 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.984s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 249561088 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 403701760 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 540016640 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 650117120 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 806354944 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lazy-loading 'flavor' on Instance uuid 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:44 user nova-compute[73208]: INFO nova.compute.manager [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Attaching volume 0ce93d7e-4784-482b-ad23-25625b411158 to /dev/vdb
Aug 16 09:13:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG os_brick.utils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8288b43a-06b0-46e2-811e-cbe9e62b586f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a091583d-d696-4436-9319-283f8ba37b52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e94631-a19c-4f78-b8f1-197e801c08ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b754004-45fc-4a83-ba12-e668a37b447e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 937426944 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:13:45 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:13:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f642d7df-29cc-4f33-b2ac-509e271e40d4]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG os_brick.utils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updating existing volume attachment record: afebeb40-abe9-42d3-aeff-ee30ca41f749 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:13:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 1013972992 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbuqViv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'f3d87c71-d765-4e72-8693-4294950e115c'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:46 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ce5974-3745-4357-9539-f4b541a2ec04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf10da-9472-4d32-a933-1e1a2417e96f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:46 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:46 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:46 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:46 user nova-compute[73208]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:46 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:46 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:46 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:46 user nova-compute[73208]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c (non-flash)
Aug 16 09:13:46 user nova-compute[73208]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:46 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d022c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c'): ({'sdf'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Removing single pathed devices sdf {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[197c8e26-bad6-47e0-b186-49be72f559d8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[04314598-bfcc-4910-895f-f44fdb367911]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Flushing IO for device /dev/sdf {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce014353-6d43-4eba-9c52-fa6342fa3686]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c6703-d6ee-49f2-922a-12d8a2240fc6]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f8b64e-f84b-44e1-b6df-962e7c04696c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9accec-79bd-4df6-8852-c019e704804e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c, portal: 172.16.0.220,3260]
Aug 16 09:13:46 user nova-compute[73208]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:46 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d87c71-d765-4e72-8693-4294950e115c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c8bf3c-e960-486e-9a4b-9a4bb033b289]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] <== disconnect_volume: return (294ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '650ba2c3-c61c-438b-8f87-79d5a98c078a', 'attached_at': '', 'detached_at': '', 'volume_id': '757a51cc-564d-4deb-bd57-d43321e44f2f', 'serial'} {{(pid=73208) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 09:13:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] swap_volume: removing Cinder connection for volume f3d87c71-d765-4e72-8693-4294950e115c {{(pid=73208) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.volume.cinder [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Update attachment failed for attachment afebeb40-abe9-42d3-aeff-ee30ca41f749. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 09:13:46 user nova-compute[73208]: Collecting current configuration:
Aug 16 09:13:46 user nova-compute[73208]: FATAL: Received the following error:
Aug 16 09:13:46 user nova-compute[73208]:         handlerAttributes(): Unable to read handler attribute '9c5eb3667202b98c': No such file or directory
Aug 16 09:13:46 user nova-compute[73208]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-16307331-1f7c-4670-a746-34c6a7d2b2dc) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error: 
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Failed to attach 0ce93d7e-4784-482b-ad23-25625b411158 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 09:13:46 user nova-compute[73208]: Collecting current configuration:
Aug 16 09:13:46 user nova-compute[73208]: FATAL: Received the following error:
Aug 16 09:13:46 user nova-compute[73208]:         handlerAttributes(): Unable to read handler attribute '9c5eb3667202b98c': No such file or directory
Aug 16 09:13:46 user nova-compute[73208]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-16307331-1f7c-4670-a746-34c6a7d2b2dc)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Traceback (most recent call last):
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     ret_val = method(obj, context, *args, **kwargs)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     self._do_attach(context, instance, volume, volume_api,
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     self._volume_attach(context, volume, connector, instance,
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     connection_info = volume_api.attachment_update(
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     res = method(self, ctx, *args, **kwargs)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     with excutils.save_and_reraise_exception():
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     self.force_reraise()
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     raise self.value
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     return method.func(obj, *args, **kwargs)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     resp = self._update('/attachments/%s' % id, body)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     return self.request(url, method, **kwargs)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]     raise exceptions.from_response(resp, body)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Collecting current configuration:
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] 
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] FATAL: Received the following error:
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] 
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a]         handlerAttributes(): Unable to read handler attribute '9c5eb3667202b98c': No such file or directory
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] 
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-16307331-1f7c-4670-a746-34c6a7d2b2dc)
Aug 16 09:13:46 user nova-compute[73208]: ERROR nova.compute.manager [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] 
Aug 16 09:13:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 2.189s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server [None req-afbd9945-635e-47fc-a204-fe772d27ee44 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 09:13:47 user nova-compute[73208]: Collecting current configuration:
Aug 16 09:13:47 user nova-compute[73208]: FATAL: Received the following error:
Aug 16 09:13:47 user nova-compute[73208]:         handlerAttributes(): Unable to read handler attribute '9c5eb3667202b98c': No such file or directory
Aug 16 09:13:47 user nova-compute[73208]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-16307331-1f7c-4670-a746-34c6a7d2b2dc)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server         handlerAttributes(): Unable to read handler attribute '9c5eb3667202b98c': No such file or directory
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:0ce93d7e-4784-482b-ad23-25625b411158 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-16307331-1f7c-4670-a746-34c6a7d2b2dc)
Aug 16 09:13:47 user nova-compute[73208]: ERROR oslo_messaging.rpc.server 
Aug 16 09:13:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] swap_volume: Updating volume f3d87c71-d765-4e72-8693-4294950e115c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "IticZwPd", "auth_password": "gGiLBoMO0XzD3w", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "757a51cc-564d-4deb-bd57-d43321e44f2f"}, "status": "reserved", "instance": "650ba2c3-c61c-438b-8f87-79d5a98c078a", "attached_at": "", "detached_at": "", "volume_id": "757a51cc-564d-4deb-bd57-d43321e44f2f", "serial": "757a51cc-564d-4deb-bd57-d43321e44f2f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '757a51cc-564d-4deb-bd57-d43321e44f2f', 'no_device': None, 'attachment_id': 'cfb136a2-76b1-4af0-8537-4a12ff97db29'} {{(pid=73208) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 09:13:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a55f77ae-1d06-4c0d-9165-9aba4ccb9ea5 tempest-TestVolumeSwap-880395795 tempest-TestVolumeSwap-880395795-project-admin] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.069s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:48 user nova-compute[73208]: INFO nova.compute.manager [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Detaching volume 757a51cc-564d-4deb-bd57-d43321e44f2f
Aug 16 09:13:48 user nova-compute[73208]: INFO nova.virt.block_device [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Attempting to driver detach volume 757a51cc-564d-4deb-bd57-d43321e44f2f from mountpoint /dev/vdb
Aug 16 09:13:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Attempting to detach device vdb from instance 650ba2c3-c61c-438b-8f87-79d5a98c078a from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:13:48 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:13:48 user nova-compute[73208]:   <source dev="/dev/sdg"/>
Aug 16 09:13:48 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:13:48 user nova-compute[73208]:   <serial>757a51cc-564d-4deb-bd57-d43321e44f2f</serial>
Aug 16 09:13:48 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:13:48 user nova-compute[73208]: </disk>
Aug 16 09:13:48 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:13:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Successfully detached device vdb from instance 650ba2c3-c61c-438b-8f87-79d5a98c078a from the persistent domain config.
Aug 16 09:13:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 650ba2c3-c61c-438b-8f87-79d5a98c078a from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:13:48 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:13:48 user nova-compute[73208]:   <source dev="/dev/sdg"/>
Aug 16 09:13:48 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:13:48 user nova-compute[73208]:   <serial>757a51cc-564d-4deb-bd57-d43321e44f2f</serial>
Aug 16 09:13:48 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:13:48 user nova-compute[73208]: </disk>
Aug 16 09:13:48 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177228.628889, 650ba2c3-c61c-438b-8f87-79d5a98c078a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:13:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Successfully detached device vdb from instance 650ba2c3-c61c-438b-8f87-79d5a98c078a from the live domain config.
Aug 16 09:13:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IticZwPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '757a51cc-564d-4deb-bd57-d43321e44f2f'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:13:48 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[defc409d-9f14-4253-adef-bdf7b87f6fb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b45033b-d2af-413f-9971-630ed34d6654]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:48 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:48 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:48 user nova-compute[73208]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:13:48 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:13:48 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:13:48 user nova-compute[73208]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f (non-flash)
Aug 16 09:13:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0372290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f'): ({'sdg'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Removing single pathed devices sdg {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e2f7c2-2295-47f1-ba87-4a8b8874d758]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51dd796-91aa-40b4-a339-53a60526941a]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Flushing IO for device /dev/sdg {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[976ddcb0-4aae-4645-8ed1-9b10ccd0da4c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f680399e-2069-4c2a-aca1-fbbcce3b00c1]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] SCSI volumes sdg have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e34be12-b3dd-44f9-be7d-c7e4106637bc]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[68135b98-1e6b-452c-967f-30ed010449a8]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260]
Aug 16 09:13:48 user nova-compute[73208]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f, portal: 172.16.0.220,3260] successful.
Aug 16 09:13:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757a51cc-564d-4deb-bd57-d43321e44f2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[48904595-8111-48db-8a6c-32db33f3ae6c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] <== disconnect_volume: return (268ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:13:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:13:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lazy-loading 'flavor' on Instance uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a1b6455-76ed-49df-bba9-fcbac7927f4a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.839s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:13:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:13:58 user nova-compute[73208]: INFO nova.compute.claims [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Claim successful on node user
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:13:58 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.policy [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '858c944850cd4fe69b6c8f782cae394a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e96874fcad4d3b8fcd66f3f513b13d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:13:58 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Creating image(s)
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.246s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk 1073741824" returned: 0 in 0.046s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Successfully created port: dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Cannot resize image /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG nova.objects.instance [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'migration_context' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Ensure instance console log exists: /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:13:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Successfully updated port: dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquired lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-0d820f22-8eb5-430f-857a-1dd0703a7ceb req-5a5101fd-3f08-4987-800c-f676cda9c454 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-changed-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-0d820f22-8eb5-430f-857a-1dd0703a7ceb req-5a5101fd-3f08-4987-800c-f676cda9c454 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Refreshing instance network info cache due to event network-changed-dab0525e-3a3f-459a-a384-55f5ed6886e2. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0d820f22-8eb5-430f-857a-1dd0703a7ceb req-5a5101fd-3f08-4987-800c-f676cda9c454 service nova] Acquiring lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.neutron [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updating instance_info_cache with network_info: [{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Releasing lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance network_info: |[{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0d820f22-8eb5-430f-857a-1dd0703a7ceb req-5a5101fd-3f08-4987-800c-f676cda9c454 service nova] Acquired lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-0d820f22-8eb5-430f-857a-1dd0703a7ceb req-5a5101fd-3f08-4987-800c-f676cda9c454 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Refreshing network info cache for port dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Start _get_guest_xml network_info=[{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:14:00 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:14:00 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-548090255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-548090255',id=16,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwJdEUl16BxJ6mhQXO60COgAMeoNKdbbkrNfM9WXFn08LFOnp0cyKzUZiknMAss58WCkPXs9/50uu1BQg/JHliga0UXhEK2dzAyXS5RlMOPiqx7aCt8h3uHTePUmCujiQ==',key_name='tempest-keypair-1890426223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-qwm6ltdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b1e6b82-35a8-44fe-ad1b-35b146491287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:14:00 user nova-compute[73208]:   <uuid>8b1e6b82-35a8-44fe-ad1b-35b146491287</uuid>
Aug 16 09:14:00 user nova-compute[73208]:   <name>instance-00000010</name>
Aug 16 09:14:00 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:14:00 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:14:00 user nova-compute[73208]:   <metadata>
Aug 16 09:14:00 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:14:00 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:14:00 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-548090255</nova:name>
Aug 16 09:14:00 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:14:00</nova:creationTime>
Aug 16 09:14:00 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:14:00 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:14:00 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:14:00 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:14:00 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:14:00 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:14:00 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:14:00 user nova-compute[73208]:       <nova:owner>
Aug 16 09:14:00 user nova-compute[73208]:         <nova:user uuid="858c944850cd4fe69b6c8f782cae394a">tempest-AttachVolumeShelveTestJSON-1142897180-project-member</nova:user>
Aug 16 09:14:00 user nova-compute[73208]:         <nova:project uuid="05e96874fcad4d3b8fcd66f3f513b13d">tempest-AttachVolumeShelveTestJSON-1142897180</nova:project>
Aug 16 09:14:00 user nova-compute[73208]:       </nova:owner>
Aug 16 09:14:00 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:14:00 user nova-compute[73208]:       <nova:ports>
Aug 16 09:14:00 user nova-compute[73208]:         <nova:port uuid="dab0525e-3a3f-459a-a384-55f5ed6886e2">
Aug 16 09:14:00 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:14:00 user nova-compute[73208]:         </nova:port>
Aug 16 09:14:00 user nova-compute[73208]:       </nova:ports>
Aug 16 09:14:00 user nova-compute[73208]:     </nova:instance>
Aug 16 09:14:00 user nova-compute[73208]:   </metadata>
Aug 16 09:14:00 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:14:00 user nova-compute[73208]:     <system>
Aug 16 09:14:00 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:14:00 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:14:00 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:14:00 user nova-compute[73208]:       <entry name="serial">8b1e6b82-35a8-44fe-ad1b-35b146491287</entry>
Aug 16 09:14:00 user nova-compute[73208]:       <entry name="uuid">8b1e6b82-35a8-44fe-ad1b-35b146491287</entry>
Aug 16 09:14:00 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:14:00 user nova-compute[73208]:     </system>
Aug 16 09:14:00 user nova-compute[73208]:   </sysinfo>
Aug 16 09:14:00 user nova-compute[73208]:   <os>
Aug 16 09:14:00 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:14:00 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:14:00 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:14:00 user nova-compute[73208]:   </os>
Aug 16 09:14:00 user nova-compute[73208]:   <features>
Aug 16 09:14:00 user nova-compute[73208]:     <acpi/>
Aug 16 09:14:00 user nova-compute[73208]:     <apic/>
Aug 16 09:14:00 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:14:00 user nova-compute[73208]:   </features>
Aug 16 09:14:00 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:14:00 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:14:00 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:14:00 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:14:00 user nova-compute[73208]:   </clock>
Aug 16 09:14:00 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:14:00 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:14:00 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:14:00 user nova-compute[73208]:   </cpu>
Aug 16 09:14:00 user nova-compute[73208]:   <devices>
Aug 16 09:14:00 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:14:00 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:14:00 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk"/>
Aug 16 09:14:00 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:14:00 user nova-compute[73208]:     </disk>
Aug 16 09:14:00 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:14:00 user nova-compute[73208]:       <mac address="fa:16:3e:66:bc:32"/>
Aug 16 09:14:00 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:14:00 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:14:00 user nova-compute[73208]:       <target dev="tapdab0525e-3a"/>
Aug 16 09:14:00 user nova-compute[73208]:     </interface>
Aug 16 09:14:00 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:14:00 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/console.log" append="off"/>
Aug 16 09:14:00 user nova-compute[73208]:     </serial>
Aug 16 09:14:00 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:14:00 user nova-compute[73208]:     <video>
Aug 16 09:14:00 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:14:00 user nova-compute[73208]:     </video>
Aug 16 09:14:00 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:14:00 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:14:00 user nova-compute[73208]:     </rng>
Aug 16 09:14:00 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:14:00 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:14:00 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:14:00 user nova-compute[73208]:     </memballoon>
Aug 16 09:14:00 user nova-compute[73208]:   </devices>
Aug 16 09:14:00 user nova-compute[73208]: </domain>
Aug 16 09:14:00 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-548090255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-548090255',id=16,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwJdEUl16BxJ6mhQXO60COgAMeoNKdbbkrNfM9WXFn08LFOnp0cyKzUZiknMAss58WCkPXs9/50uu1BQg/JHliga0UXhEK2dzAyXS5RlMOPiqx7aCt8h3uHTePUmCujiQ==',key_name='tempest-keypair-1890426223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-qwm6ltdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b1e6b82-35a8-44fe-ad1b-35b146491287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG os_vif [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdab0525e-3a, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdab0525e-3a, col_values=(('external_ids', {'iface-id': 'dab0525e-3a3f-459a-a384-55f5ed6886e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:bc:32', 'vm-uuid': '8b1e6b82-35a8-44fe-ad1b-35b146491287'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:00 user nova-compute[73208]: INFO os_vif [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a')
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:14:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No VIF found with MAC fa:16:3e:66:bc:32, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:14:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-0d820f22-8eb5-430f-857a-1dd0703a7ceb req-5a5101fd-3f08-4987-800c-f676cda9c454 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updated VIF entry in instance network info cache for port dab0525e-3a3f-459a-a384-55f5ed6886e2. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:14:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-0d820f22-8eb5-430f-857a-1dd0703a7ceb req-5a5101fd-3f08-4987-800c-f676cda9c454 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updating instance_info_cache with network_info: [{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:14:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0d820f22-8eb5-430f-857a-1dd0703a7ceb req-5a5101fd-3f08-4987-800c-f676cda9c454 service nova] Releasing lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-ef9fa9cf-5e95-4383-a440-d7a8f31b431b req-aef2cb81-74ee-442b-be22-c635d7c83f31 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ef9fa9cf-5e95-4383-a440-d7a8f31b431b req-aef2cb81-74ee-442b-be22-c635d7c83f31 service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ef9fa9cf-5e95-4383-a440-d7a8f31b431b req-aef2cb81-74ee-442b-be22-c635d7c83f31 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ef9fa9cf-5e95-4383-a440-d7a8f31b431b req-aef2cb81-74ee-442b-be22-c635d7c83f31 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-ef9fa9cf-5e95-4383-a440-d7a8f31b431b req-aef2cb81-74ee-442b-be22-c635d7c83f31 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:14:02 user nova-compute[73208]: WARNING nova.compute.manager [req-ef9fa9cf-5e95-4383-a440-d7a8f31b431b req-aef2cb81-74ee-442b-be22-c635d7c83f31 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state building and task_state spawning.
Aug 16 09:14:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177244.560739, 8b1e6b82-35a8-44fe-ad1b-35b146491287 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:14:04 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] VM Resumed (Lifecycle Event)
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:14:04 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance spawned successfully.
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-70ff0606-7bb4-486b-9675-aefb82195c86 req-80b6c9a1-bc06-48e2-a435-5097764eb17f service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-70ff0606-7bb4-486b-9675-aefb82195c86 req-80b6c9a1-bc06-48e2-a435-5097764eb17f service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-70ff0606-7bb4-486b-9675-aefb82195c86 req-80b6c9a1-bc06-48e2-a435-5097764eb17f service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-70ff0606-7bb4-486b-9675-aefb82195c86 req-80b6c9a1-bc06-48e2-a435-5097764eb17f service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-70ff0606-7bb4-486b-9675-aefb82195c86 req-80b6c9a1-bc06-48e2-a435-5097764eb17f service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:14:04 user nova-compute[73208]: WARNING nova.compute.manager [req-70ff0606-7bb4-486b-9675-aefb82195c86 req-80b6c9a1-bc06-48e2-a435-5097764eb17f service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state building and task_state spawning.
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:04 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177244.5608964, 8b1e6b82-35a8-44fe-ad1b-35b146491287 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:14:04 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] VM Started (Lifecycle Event)
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:14:04 user nova-compute[73208]: INFO nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Took 5.98 seconds to spawn the instance on the hypervisor.
Aug 16 09:14:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:04 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:14:04 user nova-compute[73208]: INFO nova.compute.manager [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Took 6.76 seconds to build instance.
Aug 16 09:14:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c418cb-6025-4486-990d-94b8a4b1cc3e tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.875s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:17 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:14:17 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:17 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:14:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "24055c32-4aea-489d-8dd9-81d46814f024" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "24055c32-4aea-489d-8dd9-81d46814f024" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:14:18 user nova-compute[73208]: INFO nova.compute.claims [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Claim successful on node user
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.policy [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1430061cf5d4c47b19ece18790df6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c480a1ba8b640bfa545bee2cf82852c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:14:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Creating image(s)
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "/opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "/opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "/opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk 1073741824" returned: 0 in 0.056s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Successfully created port: dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:14:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.202s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Cannot resize image /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.objects.instance [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lazy-loading 'migration_context' on Instance uuid 24055c32-4aea-489d-8dd9-81d46814f024 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Ensure instance console log exists: /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Successfully updated port: dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "refresh_cache-24055c32-4aea-489d-8dd9-81d46814f024" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquired lock "refresh_cache-24055c32-4aea-489d-8dd9-81d46814f024" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-92748d54-55bd-447f-971f-b184b783766c req-835eefe3-303f-40ce-b1b4-faab0e4646d8 service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received event network-changed-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-92748d54-55bd-447f-971f-b184b783766c req-835eefe3-303f-40ce-b1b4-faab0e4646d8 service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Refreshing instance network info cache due to event network-changed-dc3b0172-d09c-471e-8ac5-b66977a5cffa. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-92748d54-55bd-447f-971f-b184b783766c req-835eefe3-303f-40ce-b1b4-faab0e4646d8 service nova] Acquiring lock "refresh_cache-24055c32-4aea-489d-8dd9-81d46814f024" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Updating instance_info_cache with network_info: [{"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Releasing lock "refresh_cache-24055c32-4aea-489d-8dd9-81d46814f024" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Instance network_info: |[{"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-92748d54-55bd-447f-971f-b184b783766c req-835eefe3-303f-40ce-b1b4-faab0e4646d8 service nova] Acquired lock "refresh_cache-24055c32-4aea-489d-8dd9-81d46814f024" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.network.neutron [req-92748d54-55bd-447f-971f-b184b783766c req-835eefe3-303f-40ce-b1b4-faab0e4646d8 service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Refreshing network info cache for port dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Start _get_guest_xml network_info=[{"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:14:21 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:14:21 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-395037442',display_name='tempest-VolumesActionsTest-instance-395037442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-395037442',id=17,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c480a1ba8b640bfa545bee2cf82852c',ramdisk_id='',reservation_id='r-mfy3nusa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1567858757',owner_user_name='tempest-VolumesActionsTest-1567858757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:14:19Z,user_data=None,user_id='f1430061cf5d4c47b19ece18790df6e0',uuid=24055c32-4aea-489d-8dd9-81d46814f024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converting VIF {"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:93,bridge_name='br-int',has_traffic_filtering=True,id=dc3b0172-d09c-471e-8ac5-b66977a5cffa,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b0172-d0') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.objects.instance [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lazy-loading 'pci_devices' on Instance uuid 24055c32-4aea-489d-8dd9-81d46814f024 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:14:21 user nova-compute[73208]:   <uuid>24055c32-4aea-489d-8dd9-81d46814f024</uuid>
Aug 16 09:14:21 user nova-compute[73208]:   <name>instance-00000011</name>
Aug 16 09:14:21 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:14:21 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:14:21 user nova-compute[73208]:   <metadata>
Aug 16 09:14:21 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:14:21 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:14:21 user nova-compute[73208]:       <nova:name>tempest-VolumesActionsTest-instance-395037442</nova:name>
Aug 16 09:14:21 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:14:21</nova:creationTime>
Aug 16 09:14:21 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:14:21 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:14:21 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:14:21 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:14:21 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:14:21 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:14:21 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:14:21 user nova-compute[73208]:       <nova:owner>
Aug 16 09:14:21 user nova-compute[73208]:         <nova:user uuid="f1430061cf5d4c47b19ece18790df6e0">tempest-VolumesActionsTest-1567858757-project-member</nova:user>
Aug 16 09:14:21 user nova-compute[73208]:         <nova:project uuid="1c480a1ba8b640bfa545bee2cf82852c">tempest-VolumesActionsTest-1567858757</nova:project>
Aug 16 09:14:21 user nova-compute[73208]:       </nova:owner>
Aug 16 09:14:21 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:14:21 user nova-compute[73208]:       <nova:ports>
Aug 16 09:14:21 user nova-compute[73208]:         <nova:port uuid="dc3b0172-d09c-471e-8ac5-b66977a5cffa">
Aug 16 09:14:21 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 09:14:21 user nova-compute[73208]:         </nova:port>
Aug 16 09:14:21 user nova-compute[73208]:       </nova:ports>
Aug 16 09:14:21 user nova-compute[73208]:     </nova:instance>
Aug 16 09:14:21 user nova-compute[73208]:   </metadata>
Aug 16 09:14:21 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:14:21 user nova-compute[73208]:     <system>
Aug 16 09:14:21 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:14:21 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:14:21 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:14:21 user nova-compute[73208]:       <entry name="serial">24055c32-4aea-489d-8dd9-81d46814f024</entry>
Aug 16 09:14:21 user nova-compute[73208]:       <entry name="uuid">24055c32-4aea-489d-8dd9-81d46814f024</entry>
Aug 16 09:14:21 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:14:21 user nova-compute[73208]:     </system>
Aug 16 09:14:21 user nova-compute[73208]:   </sysinfo>
Aug 16 09:14:21 user nova-compute[73208]:   <os>
Aug 16 09:14:21 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:14:21 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:14:21 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:14:21 user nova-compute[73208]:   </os>
Aug 16 09:14:21 user nova-compute[73208]:   <features>
Aug 16 09:14:21 user nova-compute[73208]:     <acpi/>
Aug 16 09:14:21 user nova-compute[73208]:     <apic/>
Aug 16 09:14:21 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:14:21 user nova-compute[73208]:   </features>
Aug 16 09:14:21 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:14:21 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:14:21 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:14:21 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:14:21 user nova-compute[73208]:   </clock>
Aug 16 09:14:21 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:14:21 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:14:21 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:14:21 user nova-compute[73208]:   </cpu>
Aug 16 09:14:21 user nova-compute[73208]:   <devices>
Aug 16 09:14:21 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:14:21 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:14:21 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk"/>
Aug 16 09:14:21 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:14:21 user nova-compute[73208]:     </disk>
Aug 16 09:14:21 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:14:21 user nova-compute[73208]:       <mac address="fa:16:3e:90:be:93"/>
Aug 16 09:14:21 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:14:21 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:14:21 user nova-compute[73208]:       <target dev="tapdc3b0172-d0"/>
Aug 16 09:14:21 user nova-compute[73208]:     </interface>
Aug 16 09:14:21 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:14:21 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/console.log" append="off"/>
Aug 16 09:14:21 user nova-compute[73208]:     </serial>
Aug 16 09:14:21 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:14:21 user nova-compute[73208]:     <video>
Aug 16 09:14:21 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:14:21 user nova-compute[73208]:     </video>
Aug 16 09:14:21 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:14:21 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:14:21 user nova-compute[73208]:     </rng>
Aug 16 09:14:21 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:14:21 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:14:21 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:14:21 user nova-compute[73208]:     </memballoon>
Aug 16 09:14:21 user nova-compute[73208]:   </devices>
Aug 16 09:14:21 user nova-compute[73208]: </domain>
Aug 16 09:14:21 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-395037442',display_name='tempest-VolumesActionsTest-instance-395037442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-395037442',id=17,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c480a1ba8b640bfa545bee2cf82852c',ramdisk_id='',reservation_id='r-mfy3nusa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1567858757',owner_user_name='tempest-VolumesActionsTest-1567858757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:14:19Z,user_data=None,user_id='f1430061cf5d4c47b19ece18790df6e0',uuid=24055c32-4aea-489d-8dd9-81d46814f024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converting VIF {"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:93,bridge_name='br-int',has_traffic_filtering=True,id=dc3b0172-d09c-471e-8ac5-b66977a5cffa,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b0172-d0') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG os_vif [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:93,bridge_name='br-int',has_traffic_filtering=True,id=dc3b0172-d09c-471e-8ac5-b66977a5cffa,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b0172-d0') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc3b0172-d0, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc3b0172-d0, col_values=(('external_ids', {'iface-id': 'dc3b0172-d09c-471e-8ac5-b66977a5cffa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:be:93', 'vm-uuid': '24055c32-4aea-489d-8dd9-81d46814f024'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:21 user nova-compute[73208]: INFO os_vif [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:93,bridge_name='br-int',has_traffic_filtering=True,id=dc3b0172-d09c-471e-8ac5-b66977a5cffa,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b0172-d0')
Aug 16 09:14:21 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:14:21 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7782MB free_disk=25.68146514892578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] No VIF found with MAC fa:16:3e:90:be:93, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 650ba2c3-c61c-438b-8f87-79d5a98c078a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 866a499a-2f3f-4922-baf8-4aa0f821817b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8b1e6b82-35a8-44fe-ad1b-35b146491287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 24055c32-4aea-489d-8dd9-81d46814f024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.network.neutron [req-92748d54-55bd-447f-971f-b184b783766c req-835eefe3-303f-40ce-b1b4-faab0e4646d8 service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Updated VIF entry in instance network info cache for port dc3b0172-d09c-471e-8ac5-b66977a5cffa. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG nova.network.neutron [req-92748d54-55bd-447f-971f-b184b783766c req-835eefe3-303f-40ce-b1b4-faab0e4646d8 service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Updating instance_info_cache with network_info: [{"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:14:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-92748d54-55bd-447f-971f-b184b783766c req-835eefe3-303f-40ce-b1b4-faab0e4646d8 service nova] Releasing lock "refresh_cache-24055c32-4aea-489d-8dd9-81d46814f024" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:14:22 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:14:22 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:14:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:14:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-91a0a025-5860-4f23-a96e-39deb7c736b6 req-68a3e382-1842-4c41-bd9e-2a6bb746eb4c service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received event network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-91a0a025-5860-4f23-a96e-39deb7c736b6 req-68a3e382-1842-4c41-bd9e-2a6bb746eb4c service nova] Acquiring lock "24055c32-4aea-489d-8dd9-81d46814f024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-91a0a025-5860-4f23-a96e-39deb7c736b6 req-68a3e382-1842-4c41-bd9e-2a6bb746eb4c service nova] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-91a0a025-5860-4f23-a96e-39deb7c736b6 req-68a3e382-1842-4c41-bd9e-2a6bb746eb4c service nova] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-91a0a025-5860-4f23-a96e-39deb7c736b6 req-68a3e382-1842-4c41-bd9e-2a6bb746eb4c service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] No waiting events found dispatching network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:14:23 user nova-compute[73208]: WARNING nova.compute.manager [req-91a0a025-5860-4f23-a96e-39deb7c736b6 req-68a3e382-1842-4c41-bd9e-2a6bb746eb4c service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received unexpected event network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa for instance with vm_state building and task_state spawning.
Aug 16 09:14:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [{"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-beb4ea79-b782-4540-8814-09b15002b432" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177265.1234553, 24055c32-4aea-489d-8dd9-81d46814f024 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:14:25 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] VM Resumed (Lifecycle Event)
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:14:25 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Instance spawned successfully.
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:14:25 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177265.1276054, 24055c32-4aea-489d-8dd9-81d46814f024 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:14:25 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] VM Started (Lifecycle Event)
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:14:25 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-5b7a8b99-4c60-43f0-9fb9-c5015c45708d req-3cb17ec2-f533-442e-9658-48e2526fe63f service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received event network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5b7a8b99-4c60-43f0-9fb9-c5015c45708d req-3cb17ec2-f533-442e-9658-48e2526fe63f service nova] Acquiring lock "24055c32-4aea-489d-8dd9-81d46814f024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5b7a8b99-4c60-43f0-9fb9-c5015c45708d req-3cb17ec2-f533-442e-9658-48e2526fe63f service nova] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5b7a8b99-4c60-43f0-9fb9-c5015c45708d req-3cb17ec2-f533-442e-9658-48e2526fe63f service nova] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-5b7a8b99-4c60-43f0-9fb9-c5015c45708d req-3cb17ec2-f533-442e-9658-48e2526fe63f service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] No waiting events found dispatching network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:14:25 user nova-compute[73208]: WARNING nova.compute.manager [req-5b7a8b99-4c60-43f0-9fb9-c5015c45708d req-3cb17ec2-f533-442e-9658-48e2526fe63f service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received unexpected event network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa for instance with vm_state building and task_state spawning.
Aug 16 09:14:25 user nova-compute[73208]: INFO nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 16 09:14:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:25 user nova-compute[73208]: INFO nova.compute.manager [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Took 6.86 seconds to build instance.
Aug 16 09:14:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0a2371b0-d66f-4703-bca7-dfffa7e49a55 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "24055c32-4aea-489d-8dd9-81d46814f024" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.103s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:29 user nova-compute[73208]: INFO nova.compute.manager [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Detaching volume 0d85afed-c2ff-4cc5-be8d-de7f63d3ac13
Aug 16 09:14:30 user nova-compute[73208]: INFO nova.virt.block_device [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Attempting to driver detach volume 0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 from mountpoint /dev/vdb
Aug 16 09:14:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Attempting to detach device vdb from instance 866a499a-2f3f-4922-baf8-4aa0f821817b from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:14:30 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:14:30 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:14:30 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:14:30 user nova-compute[73208]:   <serial>0d85afed-c2ff-4cc5-be8d-de7f63d3ac13</serial>
Aug 16 09:14:30 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:14:30 user nova-compute[73208]: </disk>
Aug 16 09:14:30 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:14:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Successfully detached device vdb from instance 866a499a-2f3f-4922-baf8-4aa0f821817b from the persistent domain config.
Aug 16 09:14:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 866a499a-2f3f-4922-baf8-4aa0f821817b from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:14:30 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:14:30 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:14:30 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:14:30 user nova-compute[73208]:   <serial>0d85afed-c2ff-4cc5-be8d-de7f63d3ac13</serial>
Aug 16 09:14:30 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:14:30 user nova-compute[73208]: </disk>
Aug 16 09:14:30 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177270.5008857, 866a499a-2f3f-4922-baf8-4aa0f821817b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:14:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Successfully detached device vdb from instance 866a499a-2f3f-4922-baf8-4aa0f821817b from the live domain config.
Aug 16 09:14:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmWsFGCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:14:30 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7438cb8-7945-47c4-979f-af228e694a6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e0dd42-9c58-4387-a9ad-4e6c9bcafaac]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:14:30 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:14:30 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:14:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:14:30 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:14:30 user nova-compute[73208]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 (non-flash)
Aug 16 09:14:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d06409d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13'): ({'sde'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Removing single pathed devices sde {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dd8450-c859-4e33-ae1c-4e20a5b92979]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[85812575-a433-4d39-8425-17f81336bd0d]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Flushing IO for device /dev/sde {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ff2fac-b887-4e8f-a0b5-78df8de5d0c1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd1a3c-fb71-439c-91c8-89b86983c98d]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c2048-bf18-475d-baf4-6a93fbc1cb27]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058d9a0-fa73-4f22-a5d8-efef39e0214a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13, portal: 172.16.0.220,3260]
Aug 16 09:14:30 user nova-compute[73208]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13, portal: 172.16.0.220,3260] successful.
Aug 16 09:14:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85afed-c2ff-4cc5-be8d-de7f63d3ac13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d9365f-aee7-465c-a386-7410cc2995c7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] <== disconnect_volume: return (310ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:14:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:14:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:31 user nova-compute[73208]: DEBUG nova.objects.instance [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'flavor' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5add2e6b-a0d6-4263-9fa7-4cbbfce959f8 tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.864s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:38 user nova-compute[73208]: INFO nova.compute.manager [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Terminating instance
Aug 16 09:14:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-3648ffda-c570-4ebd-b1f6-babd3ba10707 req-59b790a7-c915-45c9-a090-2907f4c74123 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received event network-vif-unplugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3648ffda-c570-4ebd-b1f6-babd3ba10707 req-59b790a7-c915-45c9-a090-2907f4c74123 service nova] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3648ffda-c570-4ebd-b1f6-babd3ba10707 req-59b790a7-c915-45c9-a090-2907f4c74123 service nova] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3648ffda-c570-4ebd-b1f6-babd3ba10707 req-59b790a7-c915-45c9-a090-2907f4c74123 service nova] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-3648ffda-c570-4ebd-b1f6-babd3ba10707 req-59b790a7-c915-45c9-a090-2907f4c74123 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] No waiting events found dispatching network-vif-unplugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:14:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-3648ffda-c570-4ebd-b1f6-babd3ba10707 req-59b790a7-c915-45c9-a090-2907f4c74123 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received event network-vif-unplugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:14:39 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Instance destroyed successfully.
Aug 16 09:14:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lazy-loading 'resources' on Instance uuid 650ba2c3-c61c-438b-8f87-79d5a98c078a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1221957036',display_name='tempest-TestVolumeSwap-server-1221957036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1221957036',id=13,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfPN7e8Ra4v8TYV04lR36/auSxlLGZ7U8YKMQ8OBbkR4J0xvpr/rjmCUYxlrGrElb0+baayp6pOJvyTfGyQIwJkv+LoE7e/ThwY3u8h4i8JrnQr4Uf8lykDJy+MVLx5pg==',key_name='tempest-keypair-565264420',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cc4826a52774d7886beb8dd1f145ae0',ramdisk_id='',reservation_id='r-nkqok5sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2048536046',owner_user_name='tempest-TestVolumeSwap-2048536046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:11:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a8d8e5f626c4fce850268849137e91a',uuid=650ba2c3-c61c-438b-8f87-79d5a98c078a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Converting VIF {"id": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "address": "fa:16:3e:1d:9a:a8", "network": {"id": "a93cdfd8-98f5-450e-afba-c6ac70d4b657", "bridge": "br-int", "label": "tempest-TestVolumeSwap-663372256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc4826a52774d7886beb8dd1f145ae0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcd87-29", "ovs_interfaceid": "87fdcd87-2939-41c6-9451-f9afe4d0f63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=87fdcd87-2939-41c6-9451-f9afe4d0f63a,network=Network(a93cdfd8-98f5-450e-afba-c6ac70d4b657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcd87-29') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG os_vif [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=87fdcd87-2939-41c6-9451-f9afe4d0f63a,network=Network(a93cdfd8-98f5-450e-afba-c6ac70d4b657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcd87-29') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87fdcd87-29, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:39 user nova-compute[73208]: INFO os_vif [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=87fdcd87-2939-41c6-9451-f9afe4d0f63a,network=Network(a93cdfd8-98f5-450e-afba-c6ac70d4b657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcd87-29')
Aug 16 09:14:39 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Deleting instance files /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a_del
Aug 16 09:14:39 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Deletion of /opt/stack/data/nova/instances/650ba2c3-c61c-438b-8f87-79d5a98c078a_del complete
Aug 16 09:14:39 user nova-compute[73208]: INFO nova.compute.manager [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 09:14:39 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:14:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:14:40 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Took 0.83 seconds to deallocate network for instance.
Aug 16 09:14:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-85433d54-c2d7-46b4-892c-0e56921e7912 req-f5b006fc-d55a-465b-9f33-f94d49725d97 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received event network-vif-deleted-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:40 user nova-compute[73208]: INFO nova.compute.manager [req-85433d54-c2d7-46b4-892c-0e56921e7912 req-f5b006fc-d55a-465b-9f33-f94d49725d97 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Neutron deleted interface 87fdcd87-2939-41c6-9451-f9afe4d0f63a; detaching it from the instance and deleting it from the info cache
Aug 16 09:14:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-85433d54-c2d7-46b4-892c-0e56921e7912 req-f5b006fc-d55a-465b-9f33-f94d49725d97 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-85433d54-c2d7-46b4-892c-0e56921e7912 req-f5b006fc-d55a-465b-9f33-f94d49725d97 service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Detach interface failed, port_id=87fdcd87-2939-41c6-9451-f9afe4d0f63a, reason: Instance 650ba2c3-c61c-438b-8f87-79d5a98c078a could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:40 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Deleted allocations for instance 650ba2c3-c61c-438b-8f87-79d5a98c078a
Aug 16 09:14:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b4d4a0dc-09a2-49ff-89cc-806b4666d04a tempest-TestVolumeSwap-2048536046 tempest-TestVolumeSwap-2048536046-project-member] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.177s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-309a11b6-db92-455b-9aaa-e378c6105c97 req-1e6c540f-4134-4728-8e56-2bffabc282ad service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received event network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-309a11b6-db92-455b-9aaa-e378c6105c97 req-1e6c540f-4134-4728-8e56-2bffabc282ad service nova] Acquiring lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-309a11b6-db92-455b-9aaa-e378c6105c97 req-1e6c540f-4134-4728-8e56-2bffabc282ad service nova] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-309a11b6-db92-455b-9aaa-e378c6105c97 req-1e6c540f-4134-4728-8e56-2bffabc282ad service nova] Lock "650ba2c3-c61c-438b-8f87-79d5a98c078a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-309a11b6-db92-455b-9aaa-e378c6105c97 req-1e6c540f-4134-4728-8e56-2bffabc282ad service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] No waiting events found dispatching network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:14:40 user nova-compute[73208]: WARNING nova.compute.manager [req-309a11b6-db92-455b-9aaa-e378c6105c97 req-1e6c540f-4134-4728-8e56-2bffabc282ad service nova] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Received unexpected event network-vif-plugged-87fdcd87-2939-41c6-9451-f9afe4d0f63a for instance with vm_state deleted and task_state None.
Aug 16 09:14:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:14:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquired lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:14:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:14:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'info_cache' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating instance_info_cache with network_info: [{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Releasing lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:14:44 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance destroyed successfully.
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'resources' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG os_vif [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap898d4cd1-4f, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:44 user nova-compute[73208]: INFO os_vif [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f')
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Start _get_guest_xml network_info=[{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'numa_topology' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:44 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:14:44 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:14:44 user nova-compute[73208]:   <uuid>9fad0fe4-79f6-4023-8119-f076ba45cf4e</uuid>
Aug 16 09:14:44 user nova-compute[73208]:   <name>instance-00000005</name>
Aug 16 09:14:44 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:14:44 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:14:44 user nova-compute[73208]:   <metadata>
Aug 16 09:14:44 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:14:44 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:14:44 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeTestJSON-server-1426683030</nova:name>
Aug 16 09:14:44 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:14:44</nova:creationTime>
Aug 16 09:14:44 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:14:44 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:14:44 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:14:44 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:14:44 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:14:44 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:14:44 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:14:44 user nova-compute[73208]:       <nova:owner>
Aug 16 09:14:44 user nova-compute[73208]:         <nova:user uuid="440128c7fc3046068e7020c70ffb25d9">tempest-AttachVolumeTestJSON-60014534-project-member</nova:user>
Aug 16 09:14:44 user nova-compute[73208]:         <nova:project uuid="9e4186d2c7f14b4ab3010a7302f5f1d3">tempest-AttachVolumeTestJSON-60014534</nova:project>
Aug 16 09:14:44 user nova-compute[73208]:       </nova:owner>
Aug 16 09:14:44 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:14:44 user nova-compute[73208]:       <nova:ports>
Aug 16 09:14:44 user nova-compute[73208]:         <nova:port uuid="898d4cd1-4f35-4e2c-b563-202493263a7b">
Aug 16 09:14:44 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 09:14:44 user nova-compute[73208]:         </nova:port>
Aug 16 09:14:44 user nova-compute[73208]:       </nova:ports>
Aug 16 09:14:44 user nova-compute[73208]:     </nova:instance>
Aug 16 09:14:44 user nova-compute[73208]:   </metadata>
Aug 16 09:14:44 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:14:44 user nova-compute[73208]:     <system>
Aug 16 09:14:44 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:14:44 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:14:44 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:14:44 user nova-compute[73208]:       <entry name="serial">9fad0fe4-79f6-4023-8119-f076ba45cf4e</entry>
Aug 16 09:14:44 user nova-compute[73208]:       <entry name="uuid">9fad0fe4-79f6-4023-8119-f076ba45cf4e</entry>
Aug 16 09:14:44 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:14:44 user nova-compute[73208]:     </system>
Aug 16 09:14:44 user nova-compute[73208]:   </sysinfo>
Aug 16 09:14:44 user nova-compute[73208]:   <os>
Aug 16 09:14:44 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:14:44 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:14:44 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:14:44 user nova-compute[73208]:   </os>
Aug 16 09:14:44 user nova-compute[73208]:   <features>
Aug 16 09:14:44 user nova-compute[73208]:     <acpi/>
Aug 16 09:14:44 user nova-compute[73208]:     <apic/>
Aug 16 09:14:44 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:14:44 user nova-compute[73208]:   </features>
Aug 16 09:14:44 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:14:44 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:14:44 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:14:44 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:14:44 user nova-compute[73208]:   </clock>
Aug 16 09:14:44 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:14:44 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:14:44 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:14:44 user nova-compute[73208]:   </cpu>
Aug 16 09:14:44 user nova-compute[73208]:   <devices>
Aug 16 09:14:44 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:14:44 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:14:44 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk"/>
Aug 16 09:14:44 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:14:44 user nova-compute[73208]:     </disk>
Aug 16 09:14:44 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:14:44 user nova-compute[73208]:       <mac address="fa:16:3e:28:fe:95"/>
Aug 16 09:14:44 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:14:44 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:14:44 user nova-compute[73208]:       <target dev="tap898d4cd1-4f"/>
Aug 16 09:14:44 user nova-compute[73208]:     </interface>
Aug 16 09:14:44 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:14:44 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/console.log" append="off"/>
Aug 16 09:14:44 user nova-compute[73208]:     </serial>
Aug 16 09:14:44 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:14:44 user nova-compute[73208]:     <video>
Aug 16 09:14:44 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:14:44 user nova-compute[73208]:     </video>
Aug 16 09:14:44 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:14:44 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:14:44 user nova-compute[73208]:     </rng>
Aug 16 09:14:44 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:14:44 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:14:44 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:14:44 user nova-compute[73208]:     </memballoon>
Aug 16 09:14:44 user nova-compute[73208]:   </devices>
Aug 16 09:14:44 user nova-compute[73208]: </domain>
Aug 16 09:14:44 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:14:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Cannot resize image /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'migration_context' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG os_vif [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap898d4cd1-4f, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap898d4cd1-4f, col_values=(('external_ids', {'iface-id': '898d4cd1-4f35-4e2c-b563-202493263a7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:fe:95', 'vm-uuid': '9fad0fe4-79f6-4023-8119-f076ba45cf4e'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:14:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:45 user nova-compute[73208]: INFO os_vif [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f')
Aug 16 09:14:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-98dfa4d4-94c6-440b-b443-7a88a4dee032 req-d3a4d807-a20a-4a8f-8317-d75491214a04 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-98dfa4d4-94c6-440b-b443-7a88a4dee032 req-d3a4d807-a20a-4a8f-8317-d75491214a04 service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-98dfa4d4-94c6-440b-b443-7a88a4dee032 req-d3a4d807-a20a-4a8f-8317-d75491214a04 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-98dfa4d4-94c6-440b-b443-7a88a4dee032 req-d3a4d807-a20a-4a8f-8317-d75491214a04 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-98dfa4d4-94c6-440b-b443-7a88a4dee032 req-d3a4d807-a20a-4a8f-8317-d75491214a04 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:14:46 user nova-compute[73208]: WARNING nova.compute.manager [req-98dfa4d4-94c6-440b-b443-7a88a4dee032 req-d3a4d807-a20a-4a8f-8317-d75491214a04 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state stopped and task_state powering-on.
Aug 16 09:14:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177288.5734832, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:14:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Resumed (Lifecycle Event)
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:14:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance rebooted successfully.
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7d7cecae-1b59-4f9f-847e-e931144f41b0 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:14:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177288.5754282, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:14:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Started (Lifecycle Event)
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-ec1d9512-f5fe-4935-9654-2e5b245295a7 req-d24a941b-350a-4912-ab15-0a73a23758bf service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ec1d9512-f5fe-4935-9654-2e5b245295a7 req-d24a941b-350a-4912-ab15-0a73a23758bf service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ec1d9512-f5fe-4935-9654-2e5b245295a7 req-d24a941b-350a-4912-ab15-0a73a23758bf service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ec1d9512-f5fe-4935-9654-2e5b245295a7 req-d24a941b-350a-4912-ab15-0a73a23758bf service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:14:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-ec1d9512-f5fe-4935-9654-2e5b245295a7 req-d24a941b-350a-4912-ab15-0a73a23758bf service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:14:48 user nova-compute[73208]: WARNING nova.compute.manager [req-ec1d9512-f5fe-4935-9654-2e5b245295a7 req-d24a941b-350a-4912-ab15-0a73a23758bf service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state active and task_state None.
Aug 16 09:14:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:54 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177279.1787403, 650ba2c3-c61c-438b-8f87-79d5a98c078a => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:14:54 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] VM Stopped (Lifecycle Event)
Aug 16 09:14:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7d8a1899-bee9-494a-9279-92d715231056 None None] [instance: 650ba2c3-c61c-438b-8f87-79d5a98c078a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:14:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:14:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:15:08 user nova-compute[73208]: INFO nova.compute.claims [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Claim successful on node user
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.network.neutron [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:15:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.policy [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b7f7948212d4084b5599646e2486136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deeb19a8593540b48b0954bad0f1a0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:15:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Creating image(s)
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "/opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "/opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk 1073741824" returned: 0 in 0.053s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG nova.network.neutron [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Successfully created port: 7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Cannot resize image /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG nova.objects.instance [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'migration_context' on Instance uuid e8646f12-ea4a-4ba2-81e4-b4d9323f13ff {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Ensure instance console log exists: /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.neutron [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Successfully updated port: 7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquired lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.neutron [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-c3e48a13-08c1-44ba-9cb6-8cd3ace20c03 req-68263e78-0036-4046-91ce-fe77be7c413e service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-changed-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-c3e48a13-08c1-44ba-9cb6-8cd3ace20c03 req-68263e78-0036-4046-91ce-fe77be7c413e service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Refreshing instance network info cache due to event network-changed-7d90a76c-2029-41ac-bbba-a6119c69521d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c3e48a13-08c1-44ba-9cb6-8cd3ace20c03 req-68263e78-0036-4046-91ce-fe77be7c413e service nova] Acquiring lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.neutron [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.neutron [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updating instance_info_cache with network_info: [{"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Releasing lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Instance network_info: |[{"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c3e48a13-08c1-44ba-9cb6-8cd3ace20c03 req-68263e78-0036-4046-91ce-fe77be7c413e service nova] Acquired lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-c3e48a13-08c1-44ba-9cb6-8cd3ace20c03 req-68263e78-0036-4046-91ce-fe77be7c413e service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Refreshing network info cache for port 7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Start _get_guest_xml network_info=[{"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:15:10 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:15:10 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2112282736',display_name='tempest-TestStampPattern-server-2112282736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2112282736',id=18,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFP34sDs4CLYmubLSC4kCMpHtWHceMAeRCdklXcRBkRvJzGIHCzM0kgKwFuU1BnHR9jMIwv0gvQmT5STpCWuKJTa9HncMQEEcyd0scFYwDrZm/j986rVnynsvKDg7Y+KA==',key_name='tempest-TestStampPattern-2113117152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deeb19a8593540b48b0954bad0f1a0fb',ramdisk_id='',reservation_id='r-nv5k4kab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1918763131',owner_user_name='tempest-TestStampPattern-1918763131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:15:09Z,user_data=None,user_id='5b7f7948212d4084b5599646e2486136',uuid=e8646f12-ea4a-4ba2-81e4-b4d9323f13ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converting VIF {"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:ff,bridge_name='br-int',has_traffic_filtering=True,id=7d90a76c-2029-41ac-bbba-a6119c69521d,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d90a76c-20') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.objects.instance [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'pci_devices' on Instance uuid e8646f12-ea4a-4ba2-81e4-b4d9323f13ff {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:15:10 user nova-compute[73208]:   <uuid>e8646f12-ea4a-4ba2-81e4-b4d9323f13ff</uuid>
Aug 16 09:15:10 user nova-compute[73208]:   <name>instance-00000012</name>
Aug 16 09:15:10 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:15:10 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:15:10 user nova-compute[73208]:   <metadata>
Aug 16 09:15:10 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:15:10 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:15:10 user nova-compute[73208]:       <nova:name>tempest-TestStampPattern-server-2112282736</nova:name>
Aug 16 09:15:10 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:15:10</nova:creationTime>
Aug 16 09:15:10 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:15:10 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:15:10 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:15:10 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:15:10 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:15:10 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:15:10 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:15:10 user nova-compute[73208]:       <nova:owner>
Aug 16 09:15:10 user nova-compute[73208]:         <nova:user uuid="5b7f7948212d4084b5599646e2486136">tempest-TestStampPattern-1918763131-project-member</nova:user>
Aug 16 09:15:10 user nova-compute[73208]:         <nova:project uuid="deeb19a8593540b48b0954bad0f1a0fb">tempest-TestStampPattern-1918763131</nova:project>
Aug 16 09:15:10 user nova-compute[73208]:       </nova:owner>
Aug 16 09:15:10 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:15:10 user nova-compute[73208]:       <nova:ports>
Aug 16 09:15:10 user nova-compute[73208]:         <nova:port uuid="7d90a76c-2029-41ac-bbba-a6119c69521d">
Aug 16 09:15:10 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 09:15:10 user nova-compute[73208]:         </nova:port>
Aug 16 09:15:10 user nova-compute[73208]:       </nova:ports>
Aug 16 09:15:10 user nova-compute[73208]:     </nova:instance>
Aug 16 09:15:10 user nova-compute[73208]:   </metadata>
Aug 16 09:15:10 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:15:10 user nova-compute[73208]:     <system>
Aug 16 09:15:10 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:15:10 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:15:10 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:15:10 user nova-compute[73208]:       <entry name="serial">e8646f12-ea4a-4ba2-81e4-b4d9323f13ff</entry>
Aug 16 09:15:10 user nova-compute[73208]:       <entry name="uuid">e8646f12-ea4a-4ba2-81e4-b4d9323f13ff</entry>
Aug 16 09:15:10 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:15:10 user nova-compute[73208]:     </system>
Aug 16 09:15:10 user nova-compute[73208]:   </sysinfo>
Aug 16 09:15:10 user nova-compute[73208]:   <os>
Aug 16 09:15:10 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:15:10 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:15:10 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:15:10 user nova-compute[73208]:   </os>
Aug 16 09:15:10 user nova-compute[73208]:   <features>
Aug 16 09:15:10 user nova-compute[73208]:     <acpi/>
Aug 16 09:15:10 user nova-compute[73208]:     <apic/>
Aug 16 09:15:10 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:15:10 user nova-compute[73208]:   </features>
Aug 16 09:15:10 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:15:10 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:15:10 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:15:10 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:15:10 user nova-compute[73208]:   </clock>
Aug 16 09:15:10 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:15:10 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:15:10 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:15:10 user nova-compute[73208]:   </cpu>
Aug 16 09:15:10 user nova-compute[73208]:   <devices>
Aug 16 09:15:10 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:15:10 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:15:10 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk"/>
Aug 16 09:15:10 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:15:10 user nova-compute[73208]:     </disk>
Aug 16 09:15:10 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:15:10 user nova-compute[73208]:       <mac address="fa:16:3e:a8:83:ff"/>
Aug 16 09:15:10 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:15:10 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:15:10 user nova-compute[73208]:       <target dev="tap7d90a76c-20"/>
Aug 16 09:15:10 user nova-compute[73208]:     </interface>
Aug 16 09:15:10 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:15:10 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/console.log" append="off"/>
Aug 16 09:15:10 user nova-compute[73208]:     </serial>
Aug 16 09:15:10 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:15:10 user nova-compute[73208]:     <video>
Aug 16 09:15:10 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:15:10 user nova-compute[73208]:     </video>
Aug 16 09:15:10 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:15:10 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:15:10 user nova-compute[73208]:     </rng>
Aug 16 09:15:10 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:15:10 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:15:10 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:15:10 user nova-compute[73208]:     </memballoon>
Aug 16 09:15:10 user nova-compute[73208]:   </devices>
Aug 16 09:15:10 user nova-compute[73208]: </domain>
Aug 16 09:15:10 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2112282736',display_name='tempest-TestStampPattern-server-2112282736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2112282736',id=18,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFP34sDs4CLYmubLSC4kCMpHtWHceMAeRCdklXcRBkRvJzGIHCzM0kgKwFuU1BnHR9jMIwv0gvQmT5STpCWuKJTa9HncMQEEcyd0scFYwDrZm/j986rVnynsvKDg7Y+KA==',key_name='tempest-TestStampPattern-2113117152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deeb19a8593540b48b0954bad0f1a0fb',ramdisk_id='',reservation_id='r-nv5k4kab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1918763131',owner_user_name='tempest-TestStampPattern-1918763131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:15:09Z,user_data=None,user_id='5b7f7948212d4084b5599646e2486136',uuid=e8646f12-ea4a-4ba2-81e4-b4d9323f13ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converting VIF {"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:ff,bridge_name='br-int',has_traffic_filtering=True,id=7d90a76c-2029-41ac-bbba-a6119c69521d,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d90a76c-20') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG os_vif [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:ff,bridge_name='br-int',has_traffic_filtering=True,id=7d90a76c-2029-41ac-bbba-a6119c69521d,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d90a76c-20') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d90a76c-20, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d90a76c-20, col_values=(('external_ids', {'iface-id': '7d90a76c-2029-41ac-bbba-a6119c69521d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:83:ff', 'vm-uuid': 'e8646f12-ea4a-4ba2-81e4-b4d9323f13ff'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:15:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:10 user nova-compute[73208]: INFO os_vif [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:ff,bridge_name='br-int',has_traffic_filtering=True,id=7d90a76c-2029-41ac-bbba-a6119c69521d,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d90a76c-20')
Aug 16 09:15:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:15:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No VIF found with MAC fa:16:3e:a8:83:ff, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:15:11 user nova-compute[73208]: DEBUG nova.network.neutron [req-c3e48a13-08c1-44ba-9cb6-8cd3ace20c03 req-68263e78-0036-4046-91ce-fe77be7c413e service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updated VIF entry in instance network info cache for port 7d90a76c-2029-41ac-bbba-a6119c69521d. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:15:11 user nova-compute[73208]: DEBUG nova.network.neutron [req-c3e48a13-08c1-44ba-9cb6-8cd3ace20c03 req-68263e78-0036-4046-91ce-fe77be7c413e service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updating instance_info_cache with network_info: [{"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c3e48a13-08c1-44ba-9cb6-8cd3ace20c03 req-68263e78-0036-4046-91ce-fe77be7c413e service nova] Releasing lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:15:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-5ea6836a-a913-4081-aa59-267e1fe8d2ad req-87b2b079-a6cf-4259-b185-a6f3f650f10b service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5ea6836a-a913-4081-aa59-267e1fe8d2ad req-87b2b079-a6cf-4259-b185-a6f3f650f10b service nova] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5ea6836a-a913-4081-aa59-267e1fe8d2ad req-87b2b079-a6cf-4259-b185-a6f3f650f10b service nova] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5ea6836a-a913-4081-aa59-267e1fe8d2ad req-87b2b079-a6cf-4259-b185-a6f3f650f10b service nova] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-5ea6836a-a913-4081-aa59-267e1fe8d2ad req-87b2b079-a6cf-4259-b185-a6f3f650f10b service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] No waiting events found dispatching network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:12 user nova-compute[73208]: WARNING nova.compute.manager [req-5ea6836a-a913-4081-aa59-267e1fe8d2ad req-87b2b079-a6cf-4259-b185-a6f3f650f10b service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received unexpected event network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d for instance with vm_state building and task_state spawning.
Aug 16 09:15:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177314.6422348, e8646f12-ea4a-4ba2-81e4-b4d9323f13ff => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:15:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] VM Resumed (Lifecycle Event)
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:15:14 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Instance spawned successfully.
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:15:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177314.644178, e8646f12-ea4a-4ba2-81e4-b4d9323f13ff => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:15:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] VM Started (Lifecycle Event)
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:15:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:15:14 user nova-compute[73208]: INFO nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-c14e988a-ff9a-459d-8610-ea8a9c43545f req-5a17265e-8178-42f5-8a69-bd37761d1ea2 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c14e988a-ff9a-459d-8610-ea8a9c43545f req-5a17265e-8178-42f5-8a69-bd37761d1ea2 service nova] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c14e988a-ff9a-459d-8610-ea8a9c43545f req-5a17265e-8178-42f5-8a69-bd37761d1ea2 service nova] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c14e988a-ff9a-459d-8610-ea8a9c43545f req-5a17265e-8178-42f5-8a69-bd37761d1ea2 service nova] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-c14e988a-ff9a-459d-8610-ea8a9c43545f req-5a17265e-8178-42f5-8a69-bd37761d1ea2 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] No waiting events found dispatching network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:14 user nova-compute[73208]: WARNING nova.compute.manager [req-c14e988a-ff9a-459d-8610-ea8a9c43545f req-5a17265e-8178-42f5-8a69-bd37761d1ea2 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received unexpected event network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d for instance with vm_state building and task_state spawning.
Aug 16 09:15:14 user nova-compute[73208]: INFO nova.compute.manager [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Took 6.76 seconds to build instance.
Aug 16 09:15:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9439bbdb-e259-47cc-b7e3-03f0bd85df9f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.864s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:19 user nova-compute[73208]: INFO nova.compute.manager [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Detaching volume 613d8c6f-7e7a-49af-b022-fe8dcffc85c1
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:15:19 user nova-compute[73208]: INFO nova.virt.block_device [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Attempting to driver detach volume 613d8c6f-7e7a-49af-b022-fe8dcffc85c1 from mountpoint /dev/vdb
Aug 16 09:15:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Attempting to detach device vdb from instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:15:19 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:15:19 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:15:19 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:15:19 user nova-compute[73208]:   <serial>613d8c6f-7e7a-49af-b022-fe8dcffc85c1</serial>
Aug 16 09:15:19 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 09:15:19 user nova-compute[73208]: </disk>
Aug 16 09:15:19 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:15:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully detached device vdb from instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e from the persistent domain config.
Aug 16 09:15:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:15:19 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:15:19 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:15:19 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:15:19 user nova-compute[73208]:   <serial>613d8c6f-7e7a-49af-b022-fe8dcffc85c1</serial>
Aug 16 09:15:19 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 09:15:19 user nova-compute[73208]: </disk>
Aug 16 09:15:19 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:15:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177320.1935668, 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:15:20 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully detached device vdb from instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e from the live domain config.
Aug 16 09:15:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrOxGDaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:15:20 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8147fd-ed3e-46dd-9467-ad1a81ac2761]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce911212-956c-4409-9f47-111f4eea659e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:15:20 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:15:20 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 (non-flash)
Aug 16 09:15:20 user nova-compute[73208]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:15:20 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6fcf4a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7146a3ae-294b-464c-87cd-bbd1bf6d0b33]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5815ad-734f-4e6c-9e96-ed8a97cb2499]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[999afa98-8d85-4e32-add7-f4d5c1c4a0d9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a895a92d-561c-4f50-8b48-9af6352126ba]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:15:20 user nova-compute[73208]: INFO nova.compute.manager [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Terminating instance
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[71be4e75-8831-45ba-8a44-9107008ef840]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[44566481-0926-4b47-9d07-0fa19f343d1c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260]
Aug 16 09:15:20 user nova-compute[73208]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1, portal: 172.16.0.220,3260] successful.
Aug 16 09:15:20 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:613d8c6f-7e7a-49af-b022-fe8dcffc85c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6efcb72-26a4-4143-9da5-1f315e96618b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== disconnect_volume: return (373ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-d5267884-ac2f-42fc-931f-5ec63156f10b req-6683d4cf-a847-41af-b4a9-b69d475235c3 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received event network-vif-unplugged-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5267884-ac2f-42fc-931f-5ec63156f10b req-6683d4cf-a847-41af-b4a9-b69d475235c3 service nova] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5267884-ac2f-42fc-931f-5ec63156f10b req-6683d4cf-a847-41af-b4a9-b69d475235c3 service nova] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5267884-ac2f-42fc-931f-5ec63156f10b req-6683d4cf-a847-41af-b4a9-b69d475235c3 service nova] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-d5267884-ac2f-42fc-931f-5ec63156f10b req-6683d4cf-a847-41af-b4a9-b69d475235c3 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] No waiting events found dispatching network-vif-unplugged-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-d5267884-ac2f-42fc-931f-5ec63156f10b req-6683d4cf-a847-41af-b4a9-b69d475235c3 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received event network-vif-unplugged-8225a859-e184-4a24-a5be-864093af543b for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:21 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Instance destroyed successfully.
Aug 16 09:15:21 user nova-compute[73208]: DEBUG nova.objects.instance [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lazy-loading 'resources' on Instance uuid 866a499a-2f3f-4922-baf8-4aa0f821817b {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-804528012',display_name='tempest-TestServerVolumeAttachmentScenario-server-804528012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-804528012',id=14,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO54hNgdr/qJugZCmBcEVWnXqRr0QerfU02slGjqVwPOdQJIiwq6Kbdh5D6GS+9uogzKFhYM0Hi7xiKiV3t9cevwRNGKPMKABSEF7u0twYhVXD3nxnW0ae8QWLjoPYaf+w==',key_name='tempest-keypair-1451333951',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:11:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3be673f546e46a9852d6f6082a9f4ba',ramdisk_id='',reservation_id='r-2eadjpb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1013943466',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1013943466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6781955ea214886b8250d8899286cd2',uuid=866a499a-2f3f-4922-baf8-4aa0f821817b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Converting VIF {"id": "8225a859-e184-4a24-a5be-864093af543b", "address": "fa:16:3e:6f:ad:94", "network": {"id": "b240c104-0967-41e8-bcdc-136956a42c64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-406351500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3be673f546e46a9852d6f6082a9f4ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8225a859-e1", "ovs_interfaceid": "8225a859-e184-4a24-a5be-864093af543b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:ad:94,bridge_name='br-int',has_traffic_filtering=True,id=8225a859-e184-4a24-a5be-864093af543b,network=Network(b240c104-0967-41e8-bcdc-136956a42c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8225a859-e1') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG os_vif [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:ad:94,bridge_name='br-int',has_traffic_filtering=True,id=8225a859-e184-4a24-a5be-864093af543b,network=Network(b240c104-0967-41e8-bcdc-136956a42c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8225a859-e1') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8225a859-e1, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:15:21 user nova-compute[73208]: INFO os_vif [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:ad:94,bridge_name='br-int',has_traffic_filtering=True,id=8225a859-e184-4a24-a5be-864093af543b,network=Network(b240c104-0967-41e8-bcdc-136956a42c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8225a859-e1')
Aug 16 09:15:21 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Deleting instance files /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b_del
Aug 16 09:15:21 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Deletion of /opt/stack/data/nova/instances/866a499a-2f3f-4922-baf8-4aa0f821817b_del complete
Aug 16 09:15:21 user nova-compute[73208]: INFO nova.compute.manager [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG nova.objects.instance [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'flavor' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-401fb673-a584-4d5d-8431-77754ba83c0a tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.980s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-e92ed4b4-2e1c-44e4-afcf-0f1ca2dc3f28 req-d7475ae4-184d-4675-9872-852df2cf45b2 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received event network-vif-deleted-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:22 user nova-compute[73208]: INFO nova.compute.manager [req-e92ed4b4-2e1c-44e4-afcf-0f1ca2dc3f28 req-d7475ae4-184d-4675-9872-852df2cf45b2 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Neutron deleted interface 8225a859-e184-4a24-a5be-864093af543b; detaching it from the instance and deleting it from the info cache
Aug 16 09:15:22 user nova-compute[73208]: DEBUG nova.network.neutron [req-e92ed4b4-2e1c-44e4-afcf-0f1ca2dc3f28 req-d7475ae4-184d-4675-9872-852df2cf45b2 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:22 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Took 0.86 seconds to deallocate network for instance.
Aug 16 09:15:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-e92ed4b4-2e1c-44e4-afcf-0f1ca2dc3f28 req-d7475ae4-184d-4675-9872-852df2cf45b2 service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Detach interface failed, port_id=8225a859-e184-4a24-a5be-864093af543b, reason: Instance 866a499a-2f3f-4922-baf8-4aa0f821817b could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:22 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid '866a499a-2f3f-4922-baf8-4aa0f821817b' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid '866a499a-2f3f-4922-baf8-4aa0f821817b' (instance-0000000e)
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:22 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Deleted allocations for instance 866a499a-2f3f-4922-baf8-4aa0f821817b
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-00c283af-67c6-4850-954d-413c7c77692f tempest-TestServerVolumeAttachmentScenario-1013943466 tempest-TestServerVolumeAttachmentScenario-1013943466-project-member] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.366s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-85a34150-aa9e-41f2-b18f-5e3951965276 req-27b96134-8bed-4e4a-a54b-dd8157e7cd1e service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received event network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-85a34150-aa9e-41f2-b18f-5e3951965276 req-27b96134-8bed-4e4a-a54b-dd8157e7cd1e service nova] Acquiring lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-85a34150-aa9e-41f2-b18f-5e3951965276 req-27b96134-8bed-4e4a-a54b-dd8157e7cd1e service nova] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-85a34150-aa9e-41f2-b18f-5e3951965276 req-27b96134-8bed-4e4a-a54b-dd8157e7cd1e service nova] Lock "866a499a-2f3f-4922-baf8-4aa0f821817b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-85a34150-aa9e-41f2-b18f-5e3951965276 req-27b96134-8bed-4e4a-a54b-dd8157e7cd1e service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] No waiting events found dispatching network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:22 user nova-compute[73208]: WARNING nova.compute.manager [req-85a34150-aa9e-41f2-b18f-5e3951965276 req-27b96134-8bed-4e4a-a54b-dd8157e7cd1e service nova] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Received unexpected event network-vif-plugged-8225a859-e184-4a24-a5be-864093af543b for instance with vm_state deleted and task_state None.
Aug 16 09:15:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:15:23 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:15:23 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.639724731445312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance beb4ea79-b782-4540-8814-09b15002b432 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8b1e6b82-35a8-44fe-ad1b-35b146491287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 24055c32-4aea-489d-8dd9-81d46814f024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:15:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:25 user nova-compute[73208]: INFO nova.compute.manager [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Terminating instance
Aug 16 09:15:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:15:25 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-f2bce7e5-3d64-4640-a433-1d3e3bb6a6f6 req-8caeb1e2-5b7b-4756-abad-251d09b0de5b service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f2bce7e5-3d64-4640-a433-1d3e3bb6a6f6 req-8caeb1e2-5b7b-4756-abad-251d09b0de5b service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f2bce7e5-3d64-4640-a433-1d3e3bb6a6f6 req-8caeb1e2-5b7b-4756-abad-251d09b0de5b service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f2bce7e5-3d64-4640-a433-1d3e3bb6a6f6 req-8caeb1e2-5b7b-4756-abad-251d09b0de5b service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-f2bce7e5-3d64-4640-a433-1d3e3bb6a6f6 req-8caeb1e2-5b7b-4756-abad-251d09b0de5b service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-f2bce7e5-3d64-4640-a433-1d3e3bb6a6f6 req-8caeb1e2-5b7b-4756-abad-251d09b0de5b service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-unplugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Instance destroyed successfully.
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lazy-loading 'resources' on Instance uuid beb4ea79-b782-4540-8814-09b15002b432 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-516370955',display_name='tempest-ServerActionsTestOtherB-server-516370955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-516370955',id=4,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGoo/1PYcTdsHk3+L/ZDV/ej0Q0mRHUKoCyozxZo+08Pes7vtpT0h1QNDJDJTzbVT9HxdViQpvQJbpUeAFGEsbwYg2C6n8njqJJvHsbhMhztGJA7TRJMfd4h7CtlXUfHA==',key_name='tempest-keypair-1494130081',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:12:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc6f44a553f04c2288bdfa3593f90f87',ramdisk_id='',reservation_id='r-tszjg6v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1962627754',owner_user_name='tempest-ServerActionsTestOtherB-1962627754-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55042930262469a9989e0b9eaf44419',uuid=beb4ea79-b782-4540-8814-09b15002b432,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converting VIF {"id": "9b934682-5a56-428d-8362-8cb499a85a94", "address": "fa:16:3e:e0:7b:07", "network": {"id": "6f3f11ff-59c4-4920-9305-6e6aa8909bf9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1879811333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc6f44a553f04c2288bdfa3593f90f87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b934682-5a", "ovs_interfaceid": "9b934682-5a56-428d-8362-8cb499a85a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_vif [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b934682-5a, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:15:26 user nova-compute[73208]: INFO os_vif [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7b:07,bridge_name='br-int',has_traffic_filtering=True,id=9b934682-5a56-428d-8362-8cb499a85a94,network=Network(6f3f11ff-59c4-4920-9305-6e6aa8909bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b934682-5a')
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOIMXevc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:15:26 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc10560f-cdd8-4fbf-bb93-b508e3afd6fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dbbc8d-f855-43c2-9c92-c6a19926ae27]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:15:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c (non-flash)
Aug 16 09:15:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d02449d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[96792ad5-54e8-4173-969c-e4e285f223c4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating instance_info_cache with network_info: [{"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-9fad0fe4-79f6-4023-8119-f076ba45cf4e" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13b7bcf-9203-4181-b5fe-359ef904202b]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8edc567-9eff-474c-88f6-f3f525beede9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[14603997-153a-4216-87c0-d9d8a0bf6991]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5864da-d3ae-48cc-9f1f-6e720b2a98a7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4e2039-cea8-4496-9187-1775c9b0faaa]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260]
Aug 16 09:15:26 user nova-compute[73208]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c, portal: 172.16.0.220,3260] successful.
Aug 16 09:15:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7dc374-5cdb-4b8c-a439-828bd4f0c44c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[258543dd-79af-4da3-9cbd-3fb92cfcff7c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] <== disconnect_volume: return (269ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:15:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Deleting instance files /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432_del
Aug 16 09:15:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Deletion of /opt/stack/data/nova/instances/beb4ea79-b782-4540-8814-09b15002b432_del complete
Aug 16 09:15:26 user nova-compute[73208]: INFO nova.compute.manager [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 16 09:15:26 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:15:26 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:15:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:15:27 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:27 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] Took 0.83 seconds to deallocate network for instance.
Aug 16 09:15:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-d1d7d70e-ba9a-4306-9225-847dec0c649d req-d4a49266-3057-46e7-8668-e966ee2499ae service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-deleted-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:27 user nova-compute[73208]: INFO nova.compute.manager [req-d1d7d70e-ba9a-4306-9225-847dec0c649d req-d4a49266-3057-46e7-8668-e966ee2499ae service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Neutron deleted interface 9b934682-5a56-428d-8362-8cb499a85a94; detaching it from the instance and deleting it from the info cache
Aug 16 09:15:27 user nova-compute[73208]: DEBUG nova.network.neutron [req-d1d7d70e-ba9a-4306-9225-847dec0c649d req-d4a49266-3057-46e7-8668-e966ee2499ae service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-d1d7d70e-ba9a-4306-9225-847dec0c649d req-d4a49266-3057-46e7-8668-e966ee2499ae service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Detach interface failed, port_id=9b934682-5a56-428d-8362-8cb499a85a94, reason: Instance beb4ea79-b782-4540-8814-09b15002b432 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-9e02ee47-1933-49e7-aff3-97fd5454a38c req-5ac59321-9245-4c1e-8ce6-12e4a9b64303 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e02ee47-1933-49e7-aff3-97fd5454a38c req-5ac59321-9245-4c1e-8ce6-12e4a9b64303 service nova] Acquiring lock "beb4ea79-b782-4540-8814-09b15002b432-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e02ee47-1933-49e7-aff3-97fd5454a38c req-5ac59321-9245-4c1e-8ce6-12e4a9b64303 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e02ee47-1933-49e7-aff3-97fd5454a38c req-5ac59321-9245-4c1e-8ce6-12e4a9b64303 service nova] Lock "beb4ea79-b782-4540-8814-09b15002b432-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-9e02ee47-1933-49e7-aff3-97fd5454a38c req-5ac59321-9245-4c1e-8ce6-12e4a9b64303 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] No waiting events found dispatching network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:28 user nova-compute[73208]: WARNING nova.compute.manager [req-9e02ee47-1933-49e7-aff3-97fd5454a38c req-5ac59321-9245-4c1e-8ce6-12e4a9b64303 service nova] [instance: beb4ea79-b782-4540-8814-09b15002b432] Received unexpected event network-vif-plugged-9b934682-5a56-428d-8362-8cb499a85a94 for instance with vm_state active and task_state deleting.
Aug 16 09:15:28 user nova-compute[73208]: INFO nova.compute.manager [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] [instance: beb4ea79-b782-4540-8814-09b15002b432] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 09:15:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:15:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:28 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Deleted allocations for instance beb4ea79-b782-4540-8814-09b15002b432
Aug 16 09:15:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1b2b609d-d308-4169-8d8b-9a6e76fb3e7d tempest-ServerActionsTestOtherB-1962627754 tempest-ServerActionsTestOtherB-1962627754-project-member] Lock "beb4ea79-b782-4540-8814-09b15002b432" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.306s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:36 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177321.2313912, 866a499a-2f3f-4922-baf8-4aa0f821817b => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:15:36 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] VM Stopped (Lifecycle Event)
Aug 16 09:15:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-54a57aca-7d03-445c-9467-545a44aeb4a9 None None] [instance: 866a499a-2f3f-4922-baf8-4aa0f821817b] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:15:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:41 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177326.3123236, beb4ea79-b782-4540-8814-09b15002b432 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:15:41 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: beb4ea79-b782-4540-8814-09b15002b432] VM Stopped (Lifecycle Event)
Aug 16 09:15:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-27e4cc44-7a2c-4823-8ab3-7d3f0338c4f4 None None] [instance: beb4ea79-b782-4540-8814-09b15002b432] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:15:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-c99f8e94-7c34-4591-97a9-996d41f4288b req-7f9d2fdd-9965-4161-b065-b10158a762d9 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-changed-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-c99f8e94-7c34-4591-97a9-996d41f4288b req-7f9d2fdd-9965-4161-b065-b10158a762d9 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Refreshing instance network info cache due to event network-changed-dab0525e-3a3f-459a-a384-55f5ed6886e2. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:15:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c99f8e94-7c34-4591-97a9-996d41f4288b req-7f9d2fdd-9965-4161-b065-b10158a762d9 service nova] Acquiring lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:15:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c99f8e94-7c34-4591-97a9-996d41f4288b req-7f9d2fdd-9965-4161-b065-b10158a762d9 service nova] Acquired lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:15:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-c99f8e94-7c34-4591-97a9-996d41f4288b req-7f9d2fdd-9965-4161-b065-b10158a762d9 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Refreshing network info cache for port dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:15:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-c99f8e94-7c34-4591-97a9-996d41f4288b req-7f9d2fdd-9965-4161-b065-b10158a762d9 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updated VIF entry in instance network info cache for port dab0525e-3a3f-459a-a384-55f5ed6886e2. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:15:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-c99f8e94-7c34-4591-97a9-996d41f4288b req-7f9d2fdd-9965-4161-b065-b10158a762d9 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updating instance_info_cache with network_info: [{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c99f8e94-7c34-4591-97a9-996d41f4288b req-7f9d2fdd-9965-4161-b065-b10158a762d9 service nova] Releasing lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:15:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:54 user nova-compute[73208]: INFO nova.compute.manager [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Shelving
Aug 16 09:15:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-5af414a8-466a-458a-895d-bb2dc658ed58 req-a2e12794-ab6d-4674-9f2f-52aabd46fab8 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5af414a8-466a-458a-895d-bb2dc658ed58 req-a2e12794-ab6d-4674-9f2f-52aabd46fab8 service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5af414a8-466a-458a-895d-bb2dc658ed58 req-a2e12794-ab6d-4674-9f2f-52aabd46fab8 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5af414a8-466a-458a-895d-bb2dc658ed58 req-a2e12794-ab6d-4674-9f2f-52aabd46fab8 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-5af414a8-466a-458a-895d-bb2dc658ed58 req-a2e12794-ab6d-4674-9f2f-52aabd46fab8 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:55 user nova-compute[73208]: WARNING nova.compute.manager [req-5af414a8-466a-458a-895d-bb2dc658ed58 req-a2e12794-ab6d-4674-9f2f-52aabd46fab8 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state active and task_state shelving.
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance destroyed successfully.
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Beginning cold snapshot process
Aug 16 09:15:55 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk /opt/stack/data/nova/instances/snapshots/tmp7m86vc3e/ba29a47837944a39a33727c2d1ad0ced {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk /opt/stack/data/nova/instances/snapshots/tmp7m86vc3e/ba29a47837944a39a33727c2d1ad0ced" returned: 0 in 0.743s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:15:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Snapshot extracted, beginning image upload
Aug 16 09:15:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:57 user nova-compute[73208]: WARNING nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 09:15:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:57 user nova-compute[73208]: WARNING nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 09:15:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:57 user nova-compute[73208]: WARNING nova.compute.manager [req-40fb53f0-3a69-41a3-9f05-37170d35129f req-2004e9e7-da2d-4ba0-bedf-69d90721f0ad service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 09:15:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:15:58 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Snapshot image upload complete
Aug 16 09:15:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:15:58 user nova-compute[73208]: INFO nova.compute.manager [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Shelve offloading
Aug 16 09:15:58 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance destroyed successfully.
Aug 16 09:15:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:15:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:15:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquired lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:15:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:59 user nova-compute[73208]: WARNING nova.compute.manager [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state shelved and task_state shelving_offloading.
Aug 16 09:15:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:15:59 user nova-compute[73208]: WARNING nova.compute.manager [req-14050b48-277f-4f7b-bab8-75dda2dd6449 req-f45f7f1c-6a74-4471-b9b7-8853266be420 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state shelved and task_state shelving_offloading.
Aug 16 09:15:59 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updating instance_info_cache with network_info: [{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:15:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Releasing lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance destroyed successfully.
Aug 16 09:16:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'resources' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-548090255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-548090255',id=16,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwJdEUl16BxJ6mhQXO60COgAMeoNKdbbkrNfM9WXFn08LFOnp0cyKzUZiknMAss58WCkPXs9/50uu1BQg/JHliga0UXhEK2dzAyXS5RlMOPiqx7aCt8h3uHTePUmCujiQ==',key_name='tempest-keypair-1890426223',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:14:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-qwm6ltdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member',shelved_at='2023-08-16T09:15:58.699801',shelved_host='user',shelved_image_id='258e5dea-0007-40bb-86ba-40ebf1ff833c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:15:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b1e6b82-35a8-44fe-ad1b-35b146491287,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG os_vif [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdab0525e-3a, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:16:00 user nova-compute[73208]: INFO os_vif [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a')
Aug 16 09:16:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Deleting instance files /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287_del
Aug 16 09:16:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Deletion of /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287_del complete
Aug 16 09:16:00 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Deleted allocations for instance 8b1e6b82-35a8-44fe-ad1b-35b146491287
Aug 16 09:16:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4b4474b9-1fed-4eea-82f9-4632f41de45f tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.948s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:16:02 user nova-compute[73208]: INFO nova.compute.claims [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Claim successful on node user
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:16:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.policy [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91255b4dbf814537906275122738afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da0d7fd51c4dcaba48f74dc423e684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:16:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Creating image(s)
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "/opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "/opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "/opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk 1073741824" returned: 0 in 0.047s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Successfully created port: 428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Cannot resize image /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG nova.objects.instance [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'migration_context' on Instance uuid e23ec51a-a5cb-451b-91aa-f2b241d2b0cd {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Ensure instance console log exists: /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Successfully updated port: 428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquired lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-ab7faca3-c0b3-4dc9-aa33-be03ff97cab8 req-12e98d63-409e-43a9-9ee9-d714f053fcb5 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received event network-changed-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-ab7faca3-c0b3-4dc9-aa33-be03ff97cab8 req-12e98d63-409e-43a9-9ee9-d714f053fcb5 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Refreshing instance network info cache due to event network-changed-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ab7faca3-c0b3-4dc9-aa33-be03ff97cab8 req-12e98d63-409e-43a9-9ee9-d714f053fcb5 service nova] Acquiring lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updating instance_info_cache with network_info: [{"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Releasing lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Instance network_info: |[{"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ab7faca3-c0b3-4dc9-aa33-be03ff97cab8 req-12e98d63-409e-43a9-9ee9-d714f053fcb5 service nova] Acquired lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-ab7faca3-c0b3-4dc9-aa33-be03ff97cab8 req-12e98d63-409e-43a9-9ee9-d714f053fcb5 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Refreshing network info cache for port 428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Start _get_guest_xml network_info=[{"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:16:04 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:16:04 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1736574535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1736574535',id=19,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-5eocl155',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:16:03Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=e23ec51a-a5cb-451b-91aa-f2b241d2b0cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=428f4c85-b3f2-4f3b-b242-8450a4e0cd8d,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428f4c85-b3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.objects.instance [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'pci_devices' on Instance uuid e23ec51a-a5cb-451b-91aa-f2b241d2b0cd {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:16:04 user nova-compute[73208]:   <uuid>e23ec51a-a5cb-451b-91aa-f2b241d2b0cd</uuid>
Aug 16 09:16:04 user nova-compute[73208]:   <name>instance-00000013</name>
Aug 16 09:16:04 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:16:04 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:16:04 user nova-compute[73208]:   <metadata>
Aug 16 09:16:04 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:16:04 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:16:04 user nova-compute[73208]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1736574535</nova:name>
Aug 16 09:16:04 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:16:04</nova:creationTime>
Aug 16 09:16:04 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:16:04 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:16:04 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:16:04 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:16:04 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:16:04 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:16:04 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:16:04 user nova-compute[73208]:       <nova:owner>
Aug 16 09:16:04 user nova-compute[73208]:         <nova:user uuid="91255b4dbf814537906275122738afcf">tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member</nova:user>
Aug 16 09:16:04 user nova-compute[73208]:         <nova:project uuid="a5da0d7fd51c4dcaba48f74dc423e684">tempest-ServerBootFromVolumeStableRescueTest-1980932529</nova:project>
Aug 16 09:16:04 user nova-compute[73208]:       </nova:owner>
Aug 16 09:16:04 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:16:04 user nova-compute[73208]:       <nova:ports>
Aug 16 09:16:04 user nova-compute[73208]:         <nova:port uuid="428f4c85-b3f2-4f3b-b242-8450a4e0cd8d">
Aug 16 09:16:04 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 09:16:04 user nova-compute[73208]:         </nova:port>
Aug 16 09:16:04 user nova-compute[73208]:       </nova:ports>
Aug 16 09:16:04 user nova-compute[73208]:     </nova:instance>
Aug 16 09:16:04 user nova-compute[73208]:   </metadata>
Aug 16 09:16:04 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:16:04 user nova-compute[73208]:     <system>
Aug 16 09:16:04 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:16:04 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:16:04 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:16:04 user nova-compute[73208]:       <entry name="serial">e23ec51a-a5cb-451b-91aa-f2b241d2b0cd</entry>
Aug 16 09:16:04 user nova-compute[73208]:       <entry name="uuid">e23ec51a-a5cb-451b-91aa-f2b241d2b0cd</entry>
Aug 16 09:16:04 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:16:04 user nova-compute[73208]:     </system>
Aug 16 09:16:04 user nova-compute[73208]:   </sysinfo>
Aug 16 09:16:04 user nova-compute[73208]:   <os>
Aug 16 09:16:04 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:16:04 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:16:04 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:16:04 user nova-compute[73208]:   </os>
Aug 16 09:16:04 user nova-compute[73208]:   <features>
Aug 16 09:16:04 user nova-compute[73208]:     <acpi/>
Aug 16 09:16:04 user nova-compute[73208]:     <apic/>
Aug 16 09:16:04 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:16:04 user nova-compute[73208]:   </features>
Aug 16 09:16:04 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:16:04 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:16:04 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:16:04 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:16:04 user nova-compute[73208]:   </clock>
Aug 16 09:16:04 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:16:04 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:16:04 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:16:04 user nova-compute[73208]:   </cpu>
Aug 16 09:16:04 user nova-compute[73208]:   <devices>
Aug 16 09:16:04 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:16:04 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:16:04 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk"/>
Aug 16 09:16:04 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:16:04 user nova-compute[73208]:     </disk>
Aug 16 09:16:04 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:16:04 user nova-compute[73208]:       <mac address="fa:16:3e:02:8b:32"/>
Aug 16 09:16:04 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:16:04 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:16:04 user nova-compute[73208]:       <target dev="tap428f4c85-b3"/>
Aug 16 09:16:04 user nova-compute[73208]:     </interface>
Aug 16 09:16:04 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:16:04 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/console.log" append="off"/>
Aug 16 09:16:04 user nova-compute[73208]:     </serial>
Aug 16 09:16:04 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:16:04 user nova-compute[73208]:     <video>
Aug 16 09:16:04 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:16:04 user nova-compute[73208]:     </video>
Aug 16 09:16:04 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:16:04 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:16:04 user nova-compute[73208]:     </rng>
Aug 16 09:16:04 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:16:04 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:16:04 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:16:04 user nova-compute[73208]:     </memballoon>
Aug 16 09:16:04 user nova-compute[73208]:   </devices>
Aug 16 09:16:04 user nova-compute[73208]: </domain>
Aug 16 09:16:04 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1736574535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1736574535',id=19,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-5eocl155',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:16:03Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=e23ec51a-a5cb-451b-91aa-f2b241d2b0cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=428f4c85-b3f2-4f3b-b242-8450a4e0cd8d,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428f4c85-b3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG os_vif [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=428f4c85-b3f2-4f3b-b242-8450a4e0cd8d,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428f4c85-b3') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap428f4c85-b3, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap428f4c85-b3, col_values=(('external_ids', {'iface-id': '428f4c85-b3f2-4f3b-b242-8450a4e0cd8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:8b:32', 'vm-uuid': 'e23ec51a-a5cb-451b-91aa-f2b241d2b0cd'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:04 user nova-compute[73208]: INFO os_vif [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=428f4c85-b3f2-4f3b-b242-8450a4e0cd8d,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428f4c85-b3')
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:16:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No VIF found with MAC fa:16:3e:02:8b:32, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:16:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-ab7faca3-c0b3-4dc9-aa33-be03ff97cab8 req-12e98d63-409e-43a9-9ee9-d714f053fcb5 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updated VIF entry in instance network info cache for port 428f4c85-b3f2-4f3b-b242-8450a4e0cd8d. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:16:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-ab7faca3-c0b3-4dc9-aa33-be03ff97cab8 req-12e98d63-409e-43a9-9ee9-d714f053fcb5 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updating instance_info_cache with network_info: [{"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:16:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ab7faca3-c0b3-4dc9-aa33-be03ff97cab8 req-12e98d63-409e-43a9-9ee9-d714f053fcb5 service nova] Releasing lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-be967a25-b89b-4ea3-976f-cbb26a556aa4 req-34aced88-828d-4cf8-8344-3ddb4b473c3a service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received event network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-be967a25-b89b-4ea3-976f-cbb26a556aa4 req-34aced88-828d-4cf8-8344-3ddb4b473c3a service nova] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-be967a25-b89b-4ea3-976f-cbb26a556aa4 req-34aced88-828d-4cf8-8344-3ddb4b473c3a service nova] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-be967a25-b89b-4ea3-976f-cbb26a556aa4 req-34aced88-828d-4cf8-8344-3ddb4b473c3a service nova] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-be967a25-b89b-4ea3-976f-cbb26a556aa4 req-34aced88-828d-4cf8-8344-3ddb4b473c3a service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] No waiting events found dispatching network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:06 user nova-compute[73208]: WARNING nova.compute.manager [req-be967a25-b89b-4ea3-976f-cbb26a556aa4 req-34aced88-828d-4cf8-8344-3ddb4b473c3a service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received unexpected event network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d for instance with vm_state building and task_state spawning.
Aug 16 09:16:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177368.3563857, e23ec51a-a5cb-451b-91aa-f2b241d2b0cd => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:16:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] VM Resumed (Lifecycle Event)
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:16:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Instance spawned successfully.
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-b7914a6e-1687-4875-a91a-4d13050ef36c req-20e272ca-73c8-447c-b606-eaadd913b0fb service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received event network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b7914a6e-1687-4875-a91a-4d13050ef36c req-20e272ca-73c8-447c-b606-eaadd913b0fb service nova] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b7914a6e-1687-4875-a91a-4d13050ef36c req-20e272ca-73c8-447c-b606-eaadd913b0fb service nova] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b7914a6e-1687-4875-a91a-4d13050ef36c req-20e272ca-73c8-447c-b606-eaadd913b0fb service nova] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-b7914a6e-1687-4875-a91a-4d13050ef36c req-20e272ca-73c8-447c-b606-eaadd913b0fb service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] No waiting events found dispatching network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:08 user nova-compute[73208]: WARNING nova.compute.manager [req-b7914a6e-1687-4875-a91a-4d13050ef36c req-20e272ca-73c8-447c-b606-eaadd913b0fb service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received unexpected event network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d for instance with vm_state building and task_state spawning.
Aug 16 09:16:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177368.35757, e23ec51a-a5cb-451b-91aa-f2b241d2b0cd => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:16:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] VM Started (Lifecycle Event)
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:16:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:16:08 user nova-compute[73208]: INFO nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:08 user nova-compute[73208]: INFO nova.compute.manager [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Took 6.51 seconds to build instance.
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-385f26c4-e6d5-47f0-bb03-ad8e39084dcf tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.601s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "24055c32-4aea-489d-8dd9-81d46814f024" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "24055c32-4aea-489d-8dd9-81d46814f024" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "24055c32-4aea-489d-8dd9-81d46814f024-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Terminating instance
Aug 16 09:16:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-72266775-618c-443e-a158-583f902bcc12 req-492d1795-6e6c-4ef6-a550-3075c7f4f178 service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received event network-vif-unplugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-72266775-618c-443e-a158-583f902bcc12 req-492d1795-6e6c-4ef6-a550-3075c7f4f178 service nova] Acquiring lock "24055c32-4aea-489d-8dd9-81d46814f024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-72266775-618c-443e-a158-583f902bcc12 req-492d1795-6e6c-4ef6-a550-3075c7f4f178 service nova] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-72266775-618c-443e-a158-583f902bcc12 req-492d1795-6e6c-4ef6-a550-3075c7f4f178 service nova] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-72266775-618c-443e-a158-583f902bcc12 req-492d1795-6e6c-4ef6-a550-3075c7f4f178 service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] No waiting events found dispatching network-vif-unplugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-72266775-618c-443e-a158-583f902bcc12 req-492d1795-6e6c-4ef6-a550-3075c7f4f178 service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received event network-vif-unplugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:16:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Instance destroyed successfully.
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lazy-loading 'resources' on Instance uuid 24055c32-4aea-489d-8dd9-81d46814f024 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-395037442',display_name='tempest-VolumesActionsTest-instance-395037442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-395037442',id=17,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:14:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c480a1ba8b640bfa545bee2cf82852c',ramdisk_id='',reservation_id='r-mfy3nusa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1567858757',owner_user_name='tempest-VolumesActionsTest-1567858757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:14:25Z,user_data=None,user_id='f1430061cf5d4c47b19ece18790df6e0',uuid=24055c32-4aea-489d-8dd9-81d46814f024,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converting VIF {"id": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "address": "fa:16:3e:90:be:93", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3b0172-d0", "ovs_interfaceid": "dc3b0172-d09c-471e-8ac5-b66977a5cffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:93,bridge_name='br-int',has_traffic_filtering=True,id=dc3b0172-d09c-471e-8ac5-b66977a5cffa,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b0172-d0') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG os_vif [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:93,bridge_name='br-int',has_traffic_filtering=True,id=dc3b0172-d09c-471e-8ac5-b66977a5cffa,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b0172-d0') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc3b0172-d0, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:16:09 user nova-compute[73208]: INFO os_vif [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:93,bridge_name='br-int',has_traffic_filtering=True,id=dc3b0172-d09c-471e-8ac5-b66977a5cffa,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3b0172-d0')
Aug 16 09:16:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Deleting instance files /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024_del
Aug 16 09:16:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Deletion of /opt/stack/data/nova/instances/24055c32-4aea-489d-8dd9-81d46814f024_del complete
Aug 16 09:16:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:09 user nova-compute[73208]: INFO nova.compute.manager [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Terminating instance
Aug 16 09:16:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177355.2868316, 8b1e6b82-35a8-44fe-ad1b-35b146491287 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:16:10 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] VM Stopped (Lifecycle Event)
Aug 16 09:16:10 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Took 0.60 seconds to deallocate network for instance.
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-83cc5d84-c076-4c50-b49a-65a91f563f45 None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-d341d940-11c6-4269-a28f-a39d7de6fdc2 req-cf4bac2f-2cd1-4ad9-a5a4-b0e7863dd100 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-unplugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d341d940-11c6-4269-a28f-a39d7de6fdc2 req-cf4bac2f-2cd1-4ad9-a5a4-b0e7863dd100 service nova] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d341d940-11c6-4269-a28f-a39d7de6fdc2 req-cf4bac2f-2cd1-4ad9-a5a4-b0e7863dd100 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d341d940-11c6-4269-a28f-a39d7de6fdc2 req-cf4bac2f-2cd1-4ad9-a5a4-b0e7863dd100 service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-d341d940-11c6-4269-a28f-a39d7de6fdc2 req-cf4bac2f-2cd1-4ad9-a5a4-b0e7863dd100 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] No waiting events found dispatching network-vif-unplugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-d341d940-11c6-4269-a28f-a39d7de6fdc2 req-cf4bac2f-2cd1-4ad9-a5a4-b0e7863dd100 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-unplugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:10 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Deleted allocations for instance 24055c32-4aea-489d-8dd9-81d46814f024
Aug 16 09:16:10 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Instance destroyed successfully.
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'resources' on Instance uuid 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-261110518',display_name='tempest-ServerActionsTestOtherA-server-184088253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-261110518',id=12,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NfBFLqJtGbvXoityJVqzPb6+0NitNd540fExHmEMlMS7yAqjRzdOfdBee660sbMv3MotVe+QM6Z8SS0UbFUtsNWJuxD1BFJ1pShsGKYPAFQnGdZtf5H8KIZhfj6YNeQ==',key_name='tempest-keypair-1107223125',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-uf33iujx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=7e4b82ae-cdb8-45af-b0ef-350096e7ec3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "address": "fa:16:3e:ae:42:5f", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed694ee-58", "ovs_interfaceid": "5ed694ee-58b8-47e6-ad9e-1e1235b94f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG os_vif [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ed694ee-58, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:10 user nova-compute[73208]: INFO os_vif [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:42:5f,bridge_name='br-int',has_traffic_filtering=True,id=5ed694ee-58b8-47e6-ad9e-1e1235b94f86,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed694ee-58')
Aug 16 09:16:10 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Deleting instance files /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e_del
Aug 16 09:16:10 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Deletion of /opt/stack/data/nova/instances/7e4b82ae-cdb8-45af-b0ef-350096e7ec3e_del complete
Aug 16 09:16:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7bb6197-73ed-4654-9957-989089e7913c tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "24055c32-4aea-489d-8dd9-81d46814f024" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:10 user nova-compute[73208]: INFO nova.compute.manager [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 09:16:10 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:16:10 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:16:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-e375e0eb-03b7-45ce-a447-46c1cf4f61bd req-3382258c-8974-4232-9ec5-772612582bca service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received event network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e375e0eb-03b7-45ce-a447-46c1cf4f61bd req-3382258c-8974-4232-9ec5-772612582bca service nova] Acquiring lock "24055c32-4aea-489d-8dd9-81d46814f024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e375e0eb-03b7-45ce-a447-46c1cf4f61bd req-3382258c-8974-4232-9ec5-772612582bca service nova] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e375e0eb-03b7-45ce-a447-46c1cf4f61bd req-3382258c-8974-4232-9ec5-772612582bca service nova] Lock "24055c32-4aea-489d-8dd9-81d46814f024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-e375e0eb-03b7-45ce-a447-46c1cf4f61bd req-3382258c-8974-4232-9ec5-772612582bca service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] No waiting events found dispatching network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:11 user nova-compute[73208]: WARNING nova.compute.manager [req-e375e0eb-03b7-45ce-a447-46c1cf4f61bd req-3382258c-8974-4232-9ec5-772612582bca service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received unexpected event network-vif-plugged-dc3b0172-d09c-471e-8ac5-b66977a5cffa for instance with vm_state deleted and task_state None.
Aug 16 09:16:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-e375e0eb-03b7-45ce-a447-46c1cf4f61bd req-3382258c-8974-4232-9ec5-772612582bca service nova] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Received event network-vif-deleted-dc3b0172-d09c-471e-8ac5-b66977a5cffa {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:11 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:16:11 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Took 0.97 seconds to deallocate network for instance.
Aug 16 09:16:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:12 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:16:12 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:16:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:12 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Deleted allocations for instance 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e
Aug 16 09:16:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-1d60d74f-2605-44bf-9551-b082aa552616 req-6fadb879-f740-42b8-961d-ad03a7f5054a service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1d60d74f-2605-44bf-9551-b082aa552616 req-6fadb879-f740-42b8-961d-ad03a7f5054a service nova] Acquiring lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1d60d74f-2605-44bf-9551-b082aa552616 req-6fadb879-f740-42b8-961d-ad03a7f5054a service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1d60d74f-2605-44bf-9551-b082aa552616 req-6fadb879-f740-42b8-961d-ad03a7f5054a service nova] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-1d60d74f-2605-44bf-9551-b082aa552616 req-6fadb879-f740-42b8-961d-ad03a7f5054a service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] No waiting events found dispatching network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:12 user nova-compute[73208]: WARNING nova.compute.manager [req-1d60d74f-2605-44bf-9551-b082aa552616 req-6fadb879-f740-42b8-961d-ad03a7f5054a service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received unexpected event network-vif-plugged-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 for instance with vm_state deleted and task_state None.
Aug 16 09:16:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7966b78c-7c56-4536-adb3-20fb7ff99911 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "7e4b82ae-cdb8-45af-b0ef-350096e7ec3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.604s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:13 user nova-compute[73208]: DEBUG nova.compute.manager [req-9713c77e-bf69-48cb-a7a2-91272a54d601 req-16f5ca25-de3c-4700-ba29-47a7b811e459 service nova] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Received event network-vif-deleted-5ed694ee-58b8-47e6-ad9e-1e1235b94f86 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:19 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:19 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:19 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:16:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:22 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:16:22 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7909MB free_disk=25.69040298461914GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:16:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:24 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177369.5965679, 24055c32-4aea-489d-8dd9-81d46814f024 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:16:24 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] VM Stopped (Lifecycle Event)
Aug 16 09:16:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-939cc1c2-c3d4-439e-b001-46693bf7bd52 None None] [instance: 24055c32-4aea-489d-8dd9-81d46814f024] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:16:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:25 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:25 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177370.7467418, 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:16:25 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] VM Stopped (Lifecycle Event)
Aug 16 09:16:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f88e30f1-d2d5-4eba-99df-461551812ce8 None None] [instance: 7e4b82ae-cdb8-45af-b0ef-350096e7ec3e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:16:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:16:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:16:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:16:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:16:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:28 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updating instance_info_cache with network_info: [{"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:16:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:16:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:16:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:34 user nova-compute[73208]: INFO nova.compute.manager [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Terminating instance
Aug 16 09:16:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-4dae77de-0167-479b-ba86-1db34f84d6ec req-06f990c2-fb5f-4907-b16c-4a007665793a service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4dae77de-0167-479b-ba86-1db34f84d6ec req-06f990c2-fb5f-4907-b16c-4a007665793a service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4dae77de-0167-479b-ba86-1db34f84d6ec req-06f990c2-fb5f-4907-b16c-4a007665793a service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4dae77de-0167-479b-ba86-1db34f84d6ec req-06f990c2-fb5f-4907-b16c-4a007665793a service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-4dae77de-0167-479b-ba86-1db34f84d6ec req-06f990c2-fb5f-4907-b16c-4a007665793a service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-4dae77de-0167-479b-ba86-1db34f84d6ec req-06f990c2-fb5f-4907-b16c-4a007665793a service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-unplugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Instance destroyed successfully.
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.objects.instance [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'resources' on Instance uuid 9fad0fe4-79f6-4023-8119-f076ba45cf4e {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1426683030',display_name='tempest-AttachVolumeTestJSON-server-1426683030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1426683030',id=5,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCCjQpAG/61xdyVBnKhIr6YeNe1QNHjEcV2TwQq2ZELHUMhSsunbQ1L813Czt98lKvsGd+PB0mRLb8XSHTIzFraV8rRIzAfP/Qe3/U6+cgeJo6VL7X1UZ08IlRPFsQ7cg==',key_name='tempest-keypair-405881745',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-371ahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=9fad0fe4-79f6-4023-8119-f076ba45cf4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "898d4cd1-4f35-4e2c-b563-202493263a7b", "address": "fa:16:3e:28:fe:95", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898d4cd1-4f", "ovs_interfaceid": "898d4cd1-4f35-4e2c-b563-202493263a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG os_vif [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap898d4cd1-4f, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:35 user nova-compute[73208]: INFO os_vif [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=898d4cd1-4f35-4e2c-b563-202493263a7b,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898d4cd1-4f')
Aug 16 09:16:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Deleting instance files /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e_del
Aug 16 09:16:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Deletion of /opt/stack/data/nova/instances/9fad0fe4-79f6-4023-8119-f076ba45cf4e_del complete
Aug 16 09:16:35 user nova-compute[73208]: INFO nova.compute.manager [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 09:16:35 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:16:35 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:16:36 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:16:36 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Took 0.91 seconds to deallocate network for instance.
Aug 16 09:16:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:36 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:16:36 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:16:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:36 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Deleted allocations for instance 9fad0fe4-79f6-4023-8119-f076ba45cf4e
Aug 16 09:16:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78c51d0d-f719-4094-b41d-7ae0e2a3d8b5 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-d78356e1-539f-4b86-8238-25fdcf52ffca req-95e82cc0-2623-41c2-b48e-3bf124f389b6 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d78356e1-539f-4b86-8238-25fdcf52ffca req-95e82cc0-2623-41c2-b48e-3bf124f389b6 service nova] Acquiring lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d78356e1-539f-4b86-8238-25fdcf52ffca req-95e82cc0-2623-41c2-b48e-3bf124f389b6 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d78356e1-539f-4b86-8238-25fdcf52ffca req-95e82cc0-2623-41c2-b48e-3bf124f389b6 service nova] Lock "9fad0fe4-79f6-4023-8119-f076ba45cf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-d78356e1-539f-4b86-8238-25fdcf52ffca req-95e82cc0-2623-41c2-b48e-3bf124f389b6 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] No waiting events found dispatching network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:37 user nova-compute[73208]: WARNING nova.compute.manager [req-d78356e1-539f-4b86-8238-25fdcf52ffca req-95e82cc0-2623-41c2-b48e-3bf124f389b6 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received unexpected event network-vif-plugged-898d4cd1-4f35-4e2c-b563-202493263a7b for instance with vm_state deleted and task_state None.
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-d78356e1-539f-4b86-8238-25fdcf52ffca req-95e82cc0-2623-41c2-b48e-3bf124f389b6 service nova] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Received event network-vif-deleted-898d4cd1-4f35-4e2c-b563-202493263a7b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:16:37 user nova-compute[73208]: INFO nova.compute.claims [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Claim successful on node user
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:16:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.policy [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e67935e80e5743359098d8ef555d4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71b4a11aa5d4e939c88c1e06f14abc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:16:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Creating image(s)
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "/opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "/opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "/opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.170s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk 1073741824" returned: 0 in 0.064s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Successfully created port: d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Cannot resize image /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lazy-loading 'migration_context' on Instance uuid 058f8eb5-1d85-433a-b10c-8b3b255129c5 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Ensure instance console log exists: /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Successfully updated port: d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquired lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:16:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-6dd355ca-0935-456f-8479-8acd8e14a920 req-bc14dae4-97d2-4c1a-8fa9-cd9120058b68 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received event network-changed-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-6dd355ca-0935-456f-8479-8acd8e14a920 req-bc14dae4-97d2-4c1a-8fa9-cd9120058b68 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Refreshing instance network info cache due to event network-changed-d63ed498-03c0-4216-8146-d0344056aa06. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6dd355ca-0935-456f-8479-8acd8e14a920 req-bc14dae4-97d2-4c1a-8fa9-cd9120058b68 service nova] Acquiring lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Updating instance_info_cache with network_info: [{"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Releasing lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Instance network_info: |[{"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6dd355ca-0935-456f-8479-8acd8e14a920 req-bc14dae4-97d2-4c1a-8fa9-cd9120058b68 service nova] Acquired lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-6dd355ca-0935-456f-8479-8acd8e14a920 req-bc14dae4-97d2-4c1a-8fa9-cd9120058b68 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Refreshing network info cache for port d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Start _get_guest_xml network_info=[{"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:16:39 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:16:39 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-695212280',display_name='tempest-ServersNegativeTestJSON-server-695212280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-695212280',id=20,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b71b4a11aa5d4e939c88c1e06f14abc0',ramdisk_id='',reservation_id='r-kiok0501',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-678223637',owner_user_name='tempest-ServersNegativeTestJSON-678223637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:16:38Z,user_data=None,user_id='e67935e80e5743359098d8ef555d4f72',uuid=058f8eb5-1d85-433a-b10c-8b3b255129c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converting VIF {"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=d63ed498-03c0-4216-8146-d0344056aa06,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd63ed498-03') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lazy-loading 'pci_devices' on Instance uuid 058f8eb5-1d85-433a-b10c-8b3b255129c5 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:16:39 user nova-compute[73208]:   <uuid>058f8eb5-1d85-433a-b10c-8b3b255129c5</uuid>
Aug 16 09:16:39 user nova-compute[73208]:   <name>instance-00000014</name>
Aug 16 09:16:39 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:16:39 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:16:39 user nova-compute[73208]:   <metadata>
Aug 16 09:16:39 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:16:39 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:16:39 user nova-compute[73208]:       <nova:name>tempest-ServersNegativeTestJSON-server-695212280</nova:name>
Aug 16 09:16:39 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:16:39</nova:creationTime>
Aug 16 09:16:39 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:16:39 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:16:39 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:16:39 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:16:39 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:16:39 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:16:39 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:16:39 user nova-compute[73208]:       <nova:owner>
Aug 16 09:16:39 user nova-compute[73208]:         <nova:user uuid="e67935e80e5743359098d8ef555d4f72">tempest-ServersNegativeTestJSON-678223637-project-member</nova:user>
Aug 16 09:16:39 user nova-compute[73208]:         <nova:project uuid="b71b4a11aa5d4e939c88c1e06f14abc0">tempest-ServersNegativeTestJSON-678223637</nova:project>
Aug 16 09:16:39 user nova-compute[73208]:       </nova:owner>
Aug 16 09:16:39 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:16:39 user nova-compute[73208]:       <nova:ports>
Aug 16 09:16:39 user nova-compute[73208]:         <nova:port uuid="d63ed498-03c0-4216-8146-d0344056aa06">
Aug 16 09:16:39 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 09:16:39 user nova-compute[73208]:         </nova:port>
Aug 16 09:16:39 user nova-compute[73208]:       </nova:ports>
Aug 16 09:16:39 user nova-compute[73208]:     </nova:instance>
Aug 16 09:16:39 user nova-compute[73208]:   </metadata>
Aug 16 09:16:39 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:16:39 user nova-compute[73208]:     <system>
Aug 16 09:16:39 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:16:39 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:16:39 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:16:39 user nova-compute[73208]:       <entry name="serial">058f8eb5-1d85-433a-b10c-8b3b255129c5</entry>
Aug 16 09:16:39 user nova-compute[73208]:       <entry name="uuid">058f8eb5-1d85-433a-b10c-8b3b255129c5</entry>
Aug 16 09:16:39 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:16:39 user nova-compute[73208]:     </system>
Aug 16 09:16:39 user nova-compute[73208]:   </sysinfo>
Aug 16 09:16:39 user nova-compute[73208]:   <os>
Aug 16 09:16:39 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:16:39 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:16:39 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:16:39 user nova-compute[73208]:   </os>
Aug 16 09:16:39 user nova-compute[73208]:   <features>
Aug 16 09:16:39 user nova-compute[73208]:     <acpi/>
Aug 16 09:16:39 user nova-compute[73208]:     <apic/>
Aug 16 09:16:39 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:16:39 user nova-compute[73208]:   </features>
Aug 16 09:16:39 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:16:39 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:16:39 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:16:39 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:16:39 user nova-compute[73208]:   </clock>
Aug 16 09:16:39 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:16:39 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:16:39 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:16:39 user nova-compute[73208]:   </cpu>
Aug 16 09:16:39 user nova-compute[73208]:   <devices>
Aug 16 09:16:39 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:16:39 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:16:39 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk"/>
Aug 16 09:16:39 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:16:39 user nova-compute[73208]:     </disk>
Aug 16 09:16:39 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:16:39 user nova-compute[73208]:       <mac address="fa:16:3e:af:8a:4c"/>
Aug 16 09:16:39 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:16:39 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:16:39 user nova-compute[73208]:       <target dev="tapd63ed498-03"/>
Aug 16 09:16:39 user nova-compute[73208]:     </interface>
Aug 16 09:16:39 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:16:39 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/console.log" append="off"/>
Aug 16 09:16:39 user nova-compute[73208]:     </serial>
Aug 16 09:16:39 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:16:39 user nova-compute[73208]:     <video>
Aug 16 09:16:39 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:16:39 user nova-compute[73208]:     </video>
Aug 16 09:16:39 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:16:39 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:16:39 user nova-compute[73208]:     </rng>
Aug 16 09:16:39 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:16:39 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:16:39 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:16:39 user nova-compute[73208]:     </memballoon>
Aug 16 09:16:39 user nova-compute[73208]:   </devices>
Aug 16 09:16:39 user nova-compute[73208]: </domain>
Aug 16 09:16:39 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-695212280',display_name='tempest-ServersNegativeTestJSON-server-695212280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-695212280',id=20,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b71b4a11aa5d4e939c88c1e06f14abc0',ramdisk_id='',reservation_id='r-kiok0501',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-678223637',owner_user_name='tempest-ServersNegativeTestJSON-678223637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:16:38Z,user_data=None,user_id='e67935e80e5743359098d8ef555d4f72',uuid=058f8eb5-1d85-433a-b10c-8b3b255129c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converting VIF {"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=d63ed498-03c0-4216-8146-d0344056aa06,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd63ed498-03') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG os_vif [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=d63ed498-03c0-4216-8146-d0344056aa06,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd63ed498-03') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd63ed498-03, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd63ed498-03, col_values=(('external_ids', {'iface-id': 'd63ed498-03c0-4216-8146-d0344056aa06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:8a:4c', 'vm-uuid': '058f8eb5-1d85-433a-b10c-8b3b255129c5'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:39 user nova-compute[73208]: INFO os_vif [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=d63ed498-03c0-4216-8146-d0344056aa06,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd63ed498-03')
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] No VIF found with MAC fa:16:3e:af:8a:4c, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-6dd355ca-0935-456f-8479-8acd8e14a920 req-bc14dae4-97d2-4c1a-8fa9-cd9120058b68 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Updated VIF entry in instance network info cache for port d63ed498-03c0-4216-8146-d0344056aa06. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-6dd355ca-0935-456f-8479-8acd8e14a920 req-bc14dae4-97d2-4c1a-8fa9-cd9120058b68 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Updating instance_info_cache with network_info: [{"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:16:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6dd355ca-0935-456f-8479-8acd8e14a920 req-bc14dae4-97d2-4c1a-8fa9-cd9120058b68 service nova] Releasing lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-9002d140-d850-4c5d-b717-19ffc26daeb5 req-67058ef8-5388-47c1-ab05-7065fb2ad527 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received event network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9002d140-d850-4c5d-b717-19ffc26daeb5 req-67058ef8-5388-47c1-ab05-7065fb2ad527 service nova] Acquiring lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9002d140-d850-4c5d-b717-19ffc26daeb5 req-67058ef8-5388-47c1-ab05-7065fb2ad527 service nova] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9002d140-d850-4c5d-b717-19ffc26daeb5 req-67058ef8-5388-47c1-ab05-7065fb2ad527 service nova] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-9002d140-d850-4c5d-b717-19ffc26daeb5 req-67058ef8-5388-47c1-ab05-7065fb2ad527 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] No waiting events found dispatching network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:40 user nova-compute[73208]: WARNING nova.compute.manager [req-9002d140-d850-4c5d-b717-19ffc26daeb5 req-67058ef8-5388-47c1-ab05-7065fb2ad527 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received unexpected event network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 for instance with vm_state building and task_state spawning.
Aug 16 09:16:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177402.7018325, 058f8eb5-1d85-433a-b10c-8b3b255129c5 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:16:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] VM Resumed (Lifecycle Event)
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:16:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Instance spawned successfully.
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:16:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177402.704116, 058f8eb5-1d85-433a-b10c-8b3b255129c5 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:16:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] VM Started (Lifecycle Event)
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:16:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:16:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-d73df213-7ddd-4046-b2ca-dfc2f4eb545a req-fa7328d7-7394-4e3c-9ef7-d0d1db5d243e service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received event network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d73df213-7ddd-4046-b2ca-dfc2f4eb545a req-fa7328d7-7394-4e3c-9ef7-d0d1db5d243e service nova] Acquiring lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d73df213-7ddd-4046-b2ca-dfc2f4eb545a req-fa7328d7-7394-4e3c-9ef7-d0d1db5d243e service nova] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d73df213-7ddd-4046-b2ca-dfc2f4eb545a req-fa7328d7-7394-4e3c-9ef7-d0d1db5d243e service nova] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-d73df213-7ddd-4046-b2ca-dfc2f4eb545a req-fa7328d7-7394-4e3c-9ef7-d0d1db5d243e service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] No waiting events found dispatching network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:16:42 user nova-compute[73208]: WARNING nova.compute.manager [req-d73df213-7ddd-4046-b2ca-dfc2f4eb545a req-fa7328d7-7394-4e3c-9ef7-d0d1db5d243e service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received unexpected event network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 for instance with vm_state building and task_state spawning.
Aug 16 09:16:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Took 5.90 seconds to build instance.
Aug 16 09:16:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f369318a-5ec3-47eb-a915-13982ce06d18 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.981s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:16:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:50 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177395.4368153, 9fad0fe4-79f6-4023-8119-f076ba45cf4e => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:16:50 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] VM Stopped (Lifecycle Event)
Aug 16 09:16:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1e20a6f2-7886-47a2-a569-89d736e2186a None None] [instance: 9fad0fe4-79f6-4023-8119-f076ba45cf4e] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:16:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:16:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-e6df8db9-2564-48cd-b247-4aea3ba16766 req-a7195e63-33c1-47e6-9a08-b5fad83e9557 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-changed-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:16:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-e6df8db9-2564-48cd-b247-4aea3ba16766 req-a7195e63-33c1-47e6-9a08-b5fad83e9557 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Refreshing instance network info cache due to event network-changed-7d90a76c-2029-41ac-bbba-a6119c69521d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:16:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e6df8db9-2564-48cd-b247-4aea3ba16766 req-a7195e63-33c1-47e6-9a08-b5fad83e9557 service nova] Acquiring lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:16:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e6df8db9-2564-48cd-b247-4aea3ba16766 req-a7195e63-33c1-47e6-9a08-b5fad83e9557 service nova] Acquired lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:16:59 user nova-compute[73208]: DEBUG nova.network.neutron [req-e6df8db9-2564-48cd-b247-4aea3ba16766 req-a7195e63-33c1-47e6-9a08-b5fad83e9557 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Refreshing network info cache for port 7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'flavor' on Instance uuid e8646f12-ea4a-4ba2-81e4-b4d9323f13ff {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:00 user nova-compute[73208]: INFO nova.compute.manager [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Attaching volume d1f9eafa-79e0-406c-b8a6-4e763ba21913 to /dev/vdb
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "e136b8e0-df33-45bb-9444-191dcd24bdd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG os_brick.utils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b57f7be-5e1a-47c0-aa60-b78e3a07ea8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0440d5e-32e1-479d-a88c-7dca87ed8048]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41b69b7-41c3-4ec4-85df-069cd024191a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f132a1-0b8d-4b10-ac78-12c69654b48e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-e6df8db9-2564-48cd-b247-4aea3ba16766 req-a7195e63-33c1-47e6-9a08-b5fad83e9557 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updated VIF entry in instance network info cache for port 7d90a76c-2029-41ac-bbba-a6119c69521d. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-e6df8db9-2564-48cd-b247-4aea3ba16766 req-a7195e63-33c1-47e6-9a08-b5fad83e9557 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updating instance_info_cache with network_info: [{"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:17:00 user nova-compute[73208]: INFO nova.compute.claims [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Claim successful on node user
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e6df8db9-2564-48cd-b247-4aea3ba16766 req-a7195e63-33c1-47e6-9a08-b5fad83e9557 service nova] Releasing lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:17:00 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ad02df-5c2a-4272-b030-1688bf7daf9d]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG os_brick.utils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updating existing volume attachment record: 879bf06a-52b6-4b53-b902-c41cc11cd839 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:17:01 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.policy [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1430061cf5d4c47b19ece18790df6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c480a1ba8b640bfa545bee2cf82852c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:17:01 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Creating image(s)
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "/opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "/opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "/opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "40bcc402-c1e2-441b-ae31-400a478ea272" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "40bcc402-c1e2-441b-ae31-400a478ea272" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.215s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:17:01 user nova-compute[73208]: INFO nova.compute.claims [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Claim successful on node user
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk 1073741824" returned: 0 in 0.068s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Successfully created port: c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.245s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:17:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Cannot resize image /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.objects.instance [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lazy-loading 'migration_context' on Instance uuid e136b8e0-df33-45bb-9444-191dcd24bdd5 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Ensure instance console log exists: /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:17:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.policy [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f3eaa6fc3874b69be9f2859fce19859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b8280bca294bb6b9024f6967806d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:17:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Creating image(s)
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "/opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "/opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "/opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk 1073741824" returned: 0 in 0.056s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Successfully updated port: c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "refresh_cache-e136b8e0-df33-45bb-9444-191dcd24bdd5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquired lock "refresh_cache-e136b8e0-df33-45bb-9444-191dcd24bdd5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-ae3c8c70-17be-4db8-9b3f-d3b6603e9d86 req-7999b8f5-44a4-48ca-b3cd-55a9b01f5d2f service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received event network-changed-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-ae3c8c70-17be-4db8-9b3f-d3b6603e9d86 req-7999b8f5-44a4-48ca-b3cd-55a9b01f5d2f service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Refreshing instance network info cache due to event network-changed-c10e5d42-664f-46bf-8238-37dac3d7836b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ae3c8c70-17be-4db8-9b3f-d3b6603e9d86 req-7999b8f5-44a4-48ca-b3cd-55a9b01f5d2f service nova] Acquiring lock "refresh_cache-e136b8e0-df33-45bb-9444-191dcd24bdd5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Cannot resize image /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.objects.instance [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lazy-loading 'migration_context' on Instance uuid 40bcc402-c1e2-441b-ae31-400a478ea272 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Successfully created port: 028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Ensure instance console log exists: /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Updating instance_info_cache with network_info: [{"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Releasing lock "refresh_cache-e136b8e0-df33-45bb-9444-191dcd24bdd5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Instance network_info: |[{"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ae3c8c70-17be-4db8-9b3f-d3b6603e9d86 req-7999b8f5-44a4-48ca-b3cd-55a9b01f5d2f service nova] Acquired lock "refresh_cache-e136b8e0-df33-45bb-9444-191dcd24bdd5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.neutron [req-ae3c8c70-17be-4db8-9b3f-d3b6603e9d86 req-7999b8f5-44a4-48ca-b3cd-55a9b01f5d2f service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Refreshing network info cache for port c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Start _get_guest_xml network_info=[{"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:17:03 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:03 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1304488127',display_name='tempest-VolumesActionsTest-instance-1304488127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1304488127',id=21,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c480a1ba8b640bfa545bee2cf82852c',ramdisk_id='',reservation_id='r-j75460t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1567858757',owner_user_name='tempest-VolumesActionsTest-1567858757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:17:01Z,user_data=None,user_id='f1430061cf5d4c47b19ece18790df6e0',uuid=e136b8e0-df33-45bb-9444-191dcd24bdd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converting VIF {"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c10e5d42-664f-46bf-8238-37dac3d7836b,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10e5d42-66') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.objects.instance [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lazy-loading 'pci_devices' on Instance uuid e136b8e0-df33-45bb-9444-191dcd24bdd5 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:17:03 user nova-compute[73208]:   <uuid>e136b8e0-df33-45bb-9444-191dcd24bdd5</uuid>
Aug 16 09:17:03 user nova-compute[73208]:   <name>instance-00000015</name>
Aug 16 09:17:03 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:17:03 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:17:03 user nova-compute[73208]:   <metadata>
Aug 16 09:17:03 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:17:03 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:17:03 user nova-compute[73208]:       <nova:name>tempest-VolumesActionsTest-instance-1304488127</nova:name>
Aug 16 09:17:03 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:17:03</nova:creationTime>
Aug 16 09:17:03 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:17:03 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:17:03 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:17:03 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:17:03 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:17:03 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:17:03 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:17:03 user nova-compute[73208]:       <nova:owner>
Aug 16 09:17:03 user nova-compute[73208]:         <nova:user uuid="f1430061cf5d4c47b19ece18790df6e0">tempest-VolumesActionsTest-1567858757-project-member</nova:user>
Aug 16 09:17:03 user nova-compute[73208]:         <nova:project uuid="1c480a1ba8b640bfa545bee2cf82852c">tempest-VolumesActionsTest-1567858757</nova:project>
Aug 16 09:17:03 user nova-compute[73208]:       </nova:owner>
Aug 16 09:17:03 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:17:03 user nova-compute[73208]:       <nova:ports>
Aug 16 09:17:03 user nova-compute[73208]:         <nova:port uuid="c10e5d42-664f-46bf-8238-37dac3d7836b">
Aug 16 09:17:03 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 09:17:03 user nova-compute[73208]:         </nova:port>
Aug 16 09:17:03 user nova-compute[73208]:       </nova:ports>
Aug 16 09:17:03 user nova-compute[73208]:     </nova:instance>
Aug 16 09:17:03 user nova-compute[73208]:   </metadata>
Aug 16 09:17:03 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:17:03 user nova-compute[73208]:     <system>
Aug 16 09:17:03 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:17:03 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:17:03 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:17:03 user nova-compute[73208]:       <entry name="serial">e136b8e0-df33-45bb-9444-191dcd24bdd5</entry>
Aug 16 09:17:03 user nova-compute[73208]:       <entry name="uuid">e136b8e0-df33-45bb-9444-191dcd24bdd5</entry>
Aug 16 09:17:03 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:17:03 user nova-compute[73208]:     </system>
Aug 16 09:17:03 user nova-compute[73208]:   </sysinfo>
Aug 16 09:17:03 user nova-compute[73208]:   <os>
Aug 16 09:17:03 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:17:03 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:17:03 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:17:03 user nova-compute[73208]:   </os>
Aug 16 09:17:03 user nova-compute[73208]:   <features>
Aug 16 09:17:03 user nova-compute[73208]:     <acpi/>
Aug 16 09:17:03 user nova-compute[73208]:     <apic/>
Aug 16 09:17:03 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:17:03 user nova-compute[73208]:   </features>
Aug 16 09:17:03 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:17:03 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:17:03 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:17:03 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:17:03 user nova-compute[73208]:   </clock>
Aug 16 09:17:03 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:17:03 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:17:03 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:17:03 user nova-compute[73208]:   </cpu>
Aug 16 09:17:03 user nova-compute[73208]:   <devices>
Aug 16 09:17:03 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:17:03 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:17:03 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk"/>
Aug 16 09:17:03 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:17:03 user nova-compute[73208]:     </disk>
Aug 16 09:17:03 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:17:03 user nova-compute[73208]:       <mac address="fa:16:3e:09:5c:0f"/>
Aug 16 09:17:03 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:17:03 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:17:03 user nova-compute[73208]:       <target dev="tapc10e5d42-66"/>
Aug 16 09:17:03 user nova-compute[73208]:     </interface>
Aug 16 09:17:03 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:17:03 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/console.log" append="off"/>
Aug 16 09:17:03 user nova-compute[73208]:     </serial>
Aug 16 09:17:03 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:17:03 user nova-compute[73208]:     <video>
Aug 16 09:17:03 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:17:03 user nova-compute[73208]:     </video>
Aug 16 09:17:03 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:17:03 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:17:03 user nova-compute[73208]:     </rng>
Aug 16 09:17:03 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:17:03 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:17:03 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:17:03 user nova-compute[73208]:     </memballoon>
Aug 16 09:17:03 user nova-compute[73208]:   </devices>
Aug 16 09:17:03 user nova-compute[73208]: </domain>
Aug 16 09:17:03 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1304488127',display_name='tempest-VolumesActionsTest-instance-1304488127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1304488127',id=21,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c480a1ba8b640bfa545bee2cf82852c',ramdisk_id='',reservation_id='r-j75460t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1567858757',owner_user_name='tempest-VolumesActionsTest-1567858757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:17:01Z,user_data=None,user_id='f1430061cf5d4c47b19ece18790df6e0',uuid=e136b8e0-df33-45bb-9444-191dcd24bdd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converting VIF {"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c10e5d42-664f-46bf-8238-37dac3d7836b,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10e5d42-66') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG os_vif [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c10e5d42-664f-46bf-8238-37dac3d7836b,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10e5d42-66') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc10e5d42-66, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc10e5d42-66, col_values=(('external_ids', {'iface-id': 'c10e5d42-664f-46bf-8238-37dac3d7836b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:5c:0f', 'vm-uuid': 'e136b8e0-df33-45bb-9444-191dcd24bdd5'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:03 user nova-compute[73208]: INFO os_vif [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c10e5d42-664f-46bf-8238-37dac3d7836b,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10e5d42-66')
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:17:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] No VIF found with MAC fa:16:3e:09:5c:0f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:17:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-ae3c8c70-17be-4db8-9b3f-d3b6603e9d86 req-7999b8f5-44a4-48ca-b3cd-55a9b01f5d2f service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Updated VIF entry in instance network info cache for port c10e5d42-664f-46bf-8238-37dac3d7836b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:17:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-ae3c8c70-17be-4db8-9b3f-d3b6603e9d86 req-7999b8f5-44a4-48ca-b3cd-55a9b01f5d2f service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Updating instance_info_cache with network_info: [{"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ae3c8c70-17be-4db8-9b3f-d3b6603e9d86 req-7999b8f5-44a4-48ca-b3cd-55a9b01f5d2f service nova] Releasing lock "refresh_cache-e136b8e0-df33-45bb-9444-191dcd24bdd5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Successfully updated port: 028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:17:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "refresh_cache-40bcc402-c1e2-441b-ae31-400a478ea272" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:17:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquired lock "refresh_cache-40bcc402-c1e2-441b-ae31-400a478ea272" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:17:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:17:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-3535f05d-9c74-4f9e-8fb4-bb0c4f19b9ae req-6a8f7e2e-e491-42fe-af81-1c24f3d645f4 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received event network-changed-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-3535f05d-9c74-4f9e-8fb4-bb0c4f19b9ae req-6a8f7e2e-e491-42fe-af81-1c24f3d645f4 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Refreshing instance network info cache due to event network-changed-028d4486-2056-4758-b959-08b2baeee08e. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3535f05d-9c74-4f9e-8fb4-bb0c4f19b9ae req-6a8f7e2e-e491-42fe-af81-1c24f3d645f4 service nova] Acquiring lock "refresh_cache-40bcc402-c1e2-441b-ae31-400a478ea272" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Updating instance_info_cache with network_info: [{"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Releasing lock "refresh_cache-40bcc402-c1e2-441b-ae31-400a478ea272" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Instance network_info: |[{"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3535f05d-9c74-4f9e-8fb4-bb0c4f19b9ae req-6a8f7e2e-e491-42fe-af81-1c24f3d645f4 service nova] Acquired lock "refresh_cache-40bcc402-c1e2-441b-ae31-400a478ea272" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-3535f05d-9c74-4f9e-8fb4-bb0c4f19b9ae req-6a8f7e2e-e491-42fe-af81-1c24f3d645f4 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Refreshing network info cache for port 028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Start _get_guest_xml network_info=[{"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:17:05 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:05 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-5e16be12-571e-493b-8ece-88db906a0cfa req-e83f328c-f915-4e03-a589-d90ee34d50f5 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received event network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5e16be12-571e-493b-8ece-88db906a0cfa req-e83f328c-f915-4e03-a589-d90ee34d50f5 service nova] Acquiring lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5e16be12-571e-493b-8ece-88db906a0cfa req-e83f328c-f915-4e03-a589-d90ee34d50f5 service nova] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5e16be12-571e-493b-8ece-88db906a0cfa req-e83f328c-f915-4e03-a589-d90ee34d50f5 service nova] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-5e16be12-571e-493b-8ece-88db906a0cfa req-e83f328c-f915-4e03-a589-d90ee34d50f5 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] No waiting events found dispatching network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:17:05 user nova-compute[73208]: WARNING nova.compute.manager [req-5e16be12-571e-493b-8ece-88db906a0cfa req-e83f328c-f915-4e03-a589-d90ee34d50f5 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received unexpected event network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b for instance with vm_state building and task_state spawning.
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-124950737',display_name='tempest-VolumesAdminNegativeTest-server-124950737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-124950737',id=22,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75b8280bca294bb6b9024f6967806d62',ramdisk_id='',reservation_id='r-hhn7aok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-840118071',owner_user_name='tempest-VolumesAdminNegativeTest-840118071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:17:02Z,user_data=None,user_id='1f3eaa6fc3874b69be9f2859fce19859',uuid=40bcc402-c1e2-441b-ae31-400a478ea272,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converting VIF {"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:1d,bridge_name='br-int',has_traffic_filtering=True,id=028d4486-2056-4758-b959-08b2baeee08e,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028d4486-20') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.objects.instance [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lazy-loading 'pci_devices' on Instance uuid 40bcc402-c1e2-441b-ae31-400a478ea272 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:17:05 user nova-compute[73208]:   <uuid>40bcc402-c1e2-441b-ae31-400a478ea272</uuid>
Aug 16 09:17:05 user nova-compute[73208]:   <name>instance-00000016</name>
Aug 16 09:17:05 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:17:05 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:17:05 user nova-compute[73208]:   <metadata>
Aug 16 09:17:05 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:17:05 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:17:05 user nova-compute[73208]:       <nova:name>tempest-VolumesAdminNegativeTest-server-124950737</nova:name>
Aug 16 09:17:05 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:17:05</nova:creationTime>
Aug 16 09:17:05 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:17:05 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:17:05 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:17:05 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:17:05 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:17:05 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:17:05 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:17:05 user nova-compute[73208]:       <nova:owner>
Aug 16 09:17:05 user nova-compute[73208]:         <nova:user uuid="1f3eaa6fc3874b69be9f2859fce19859">tempest-VolumesAdminNegativeTest-840118071-project-member</nova:user>
Aug 16 09:17:05 user nova-compute[73208]:         <nova:project uuid="75b8280bca294bb6b9024f6967806d62">tempest-VolumesAdminNegativeTest-840118071</nova:project>
Aug 16 09:17:05 user nova-compute[73208]:       </nova:owner>
Aug 16 09:17:05 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:17:05 user nova-compute[73208]:       <nova:ports>
Aug 16 09:17:05 user nova-compute[73208]:         <nova:port uuid="028d4486-2056-4758-b959-08b2baeee08e">
Aug 16 09:17:05 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 09:17:05 user nova-compute[73208]:         </nova:port>
Aug 16 09:17:05 user nova-compute[73208]:       </nova:ports>
Aug 16 09:17:05 user nova-compute[73208]:     </nova:instance>
Aug 16 09:17:05 user nova-compute[73208]:   </metadata>
Aug 16 09:17:05 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:17:05 user nova-compute[73208]:     <system>
Aug 16 09:17:05 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:17:05 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:17:05 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:17:05 user nova-compute[73208]:       <entry name="serial">40bcc402-c1e2-441b-ae31-400a478ea272</entry>
Aug 16 09:17:05 user nova-compute[73208]:       <entry name="uuid">40bcc402-c1e2-441b-ae31-400a478ea272</entry>
Aug 16 09:17:05 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:17:05 user nova-compute[73208]:     </system>
Aug 16 09:17:05 user nova-compute[73208]:   </sysinfo>
Aug 16 09:17:05 user nova-compute[73208]:   <os>
Aug 16 09:17:05 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:17:05 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:17:05 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:17:05 user nova-compute[73208]:   </os>
Aug 16 09:17:05 user nova-compute[73208]:   <features>
Aug 16 09:17:05 user nova-compute[73208]:     <acpi/>
Aug 16 09:17:05 user nova-compute[73208]:     <apic/>
Aug 16 09:17:05 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:17:05 user nova-compute[73208]:   </features>
Aug 16 09:17:05 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:17:05 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:17:05 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:17:05 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:17:05 user nova-compute[73208]:   </clock>
Aug 16 09:17:05 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:17:05 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:17:05 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:17:05 user nova-compute[73208]:   </cpu>
Aug 16 09:17:05 user nova-compute[73208]:   <devices>
Aug 16 09:17:05 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:17:05 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:17:05 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk"/>
Aug 16 09:17:05 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:17:05 user nova-compute[73208]:     </disk>
Aug 16 09:17:05 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:17:05 user nova-compute[73208]:       <mac address="fa:16:3e:ea:49:1d"/>
Aug 16 09:17:05 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:17:05 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:17:05 user nova-compute[73208]:       <target dev="tap028d4486-20"/>
Aug 16 09:17:05 user nova-compute[73208]:     </interface>
Aug 16 09:17:05 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:17:05 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/console.log" append="off"/>
Aug 16 09:17:05 user nova-compute[73208]:     </serial>
Aug 16 09:17:05 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:17:05 user nova-compute[73208]:     <video>
Aug 16 09:17:05 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:17:05 user nova-compute[73208]:     </video>
Aug 16 09:17:05 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:17:05 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:17:05 user nova-compute[73208]:     </rng>
Aug 16 09:17:05 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:17:05 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:17:05 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:17:05 user nova-compute[73208]:     </memballoon>
Aug 16 09:17:05 user nova-compute[73208]:   </devices>
Aug 16 09:17:05 user nova-compute[73208]: </domain>
Aug 16 09:17:05 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-124950737',display_name='tempest-VolumesAdminNegativeTest-server-124950737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-124950737',id=22,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75b8280bca294bb6b9024f6967806d62',ramdisk_id='',reservation_id='r-hhn7aok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-840118071',owner_user_name='tempest-VolumesAdminNegativeTest-840118071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:17:02Z,user_data=None,user_id='1f3eaa6fc3874b69be9f2859fce19859',uuid=40bcc402-c1e2-441b-ae31-400a478ea272,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converting VIF {"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:1d,bridge_name='br-int',has_traffic_filtering=True,id=028d4486-2056-4758-b959-08b2baeee08e,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028d4486-20') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG os_vif [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:1d,bridge_name='br-int',has_traffic_filtering=True,id=028d4486-2056-4758-b959-08b2baeee08e,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028d4486-20') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap028d4486-20, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap028d4486-20, col_values=(('external_ids', {'iface-id': '028d4486-2056-4758-b959-08b2baeee08e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:49:1d', 'vm-uuid': '40bcc402-c1e2-441b-ae31-400a478ea272'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: INFO os_vif [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:1d,bridge_name='br-int',has_traffic_filtering=True,id=028d4486-2056-4758-b959-08b2baeee08e,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028d4486-20')
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] No VIF found with MAC fa:16:3e:ea:49:1d, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-3535f05d-9c74-4f9e-8fb4-bb0c4f19b9ae req-6a8f7e2e-e491-42fe-af81-1c24f3d645f4 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Updated VIF entry in instance network info cache for port 028d4486-2056-4758-b959-08b2baeee08e. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-3535f05d-9c74-4f9e-8fb4-bb0c4f19b9ae req-6a8f7e2e-e491-42fe-af81-1c24f3d645f4 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Updating instance_info_cache with network_info: [{"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3535f05d-9c74-4f9e-8fb4-bb0c4f19b9ae req-6a8f7e2e-e491-42fe-af81-1c24f3d645f4 service nova] Releasing lock "refresh_cache-40bcc402-c1e2-441b-ae31-400a478ea272" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [req-32068da8-c41a-41ee-ab1d-8d6a7d9cfb23 req-abe233d6-81e1-4603-a2ed-79f408d87e87 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received event network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32068da8-c41a-41ee-ab1d-8d6a7d9cfb23 req-abe233d6-81e1-4603-a2ed-79f408d87e87 service nova] Acquiring lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32068da8-c41a-41ee-ab1d-8d6a7d9cfb23 req-abe233d6-81e1-4603-a2ed-79f408d87e87 service nova] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32068da8-c41a-41ee-ab1d-8d6a7d9cfb23 req-abe233d6-81e1-4603-a2ed-79f408d87e87 service nova] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [req-32068da8-c41a-41ee-ab1d-8d6a7d9cfb23 req-abe233d6-81e1-4603-a2ed-79f408d87e87 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] No waiting events found dispatching network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:17:07 user nova-compute[73208]: WARNING nova.compute.manager [req-32068da8-c41a-41ee-ab1d-8d6a7d9cfb23 req-abe233d6-81e1-4603-a2ed-79f408d87e87 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received unexpected event network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e for instance with vm_state building and task_state spawning.
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177427.2837431, e136b8e0-df33-45bb-9444-191dcd24bdd5 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:17:07 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] VM Resumed (Lifecycle Event)
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:17:07 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Instance spawned successfully.
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:07 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177427.2887864, e136b8e0-df33-45bb-9444-191dcd24bdd5 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:17:07 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] VM Started (Lifecycle Event)
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:17:07 user nova-compute[73208]: INFO nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:07 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [req-998d5cb2-81ba-4dac-9c20-764e2a35ee5d req-6b0cdad9-8051-40f2-a202-6bc2b15f1955 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received event network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-998d5cb2-81ba-4dac-9c20-764e2a35ee5d req-6b0cdad9-8051-40f2-a202-6bc2b15f1955 service nova] Acquiring lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-998d5cb2-81ba-4dac-9c20-764e2a35ee5d req-6b0cdad9-8051-40f2-a202-6bc2b15f1955 service nova] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-998d5cb2-81ba-4dac-9c20-764e2a35ee5d req-6b0cdad9-8051-40f2-a202-6bc2b15f1955 service nova] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:07 user nova-compute[73208]: DEBUG nova.compute.manager [req-998d5cb2-81ba-4dac-9c20-764e2a35ee5d req-6b0cdad9-8051-40f2-a202-6bc2b15f1955 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] No waiting events found dispatching network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:17:07 user nova-compute[73208]: WARNING nova.compute.manager [req-998d5cb2-81ba-4dac-9c20-764e2a35ee5d req-6b0cdad9-8051-40f2-a202-6bc2b15f1955 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received unexpected event network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b for instance with vm_state building and task_state spawning.
Aug 16 09:17:07 user nova-compute[73208]: INFO nova.compute.manager [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Took 6.94 seconds to build instance.
Aug 16 09:17:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71377f21-6641-4f4a-8487-e6c8583299e7 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.044s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177429.183855, 40bcc402-c1e2-441b-ae31-400a478ea272 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:17:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] VM Resumed (Lifecycle Event)
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:17:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Instance spawned successfully.
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177429.1875892, 40bcc402-c1e2-441b-ae31-400a478ea272 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:17:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] VM Started (Lifecycle Event)
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-d5badc34-e549-4873-99ce-78dd909ec050 req-1685a788-63e1-4d55-a12c-e3f984418cd4 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received event network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5badc34-e549-4873-99ce-78dd909ec050 req-1685a788-63e1-4d55-a12c-e3f984418cd4 service nova] Acquiring lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5badc34-e549-4873-99ce-78dd909ec050 req-1685a788-63e1-4d55-a12c-e3f984418cd4 service nova] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5badc34-e549-4873-99ce-78dd909ec050 req-1685a788-63e1-4d55-a12c-e3f984418cd4 service nova] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-d5badc34-e549-4873-99ce-78dd909ec050 req-1685a788-63e1-4d55-a12c-e3f984418cd4 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] No waiting events found dispatching network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:17:09 user nova-compute[73208]: WARNING nova.compute.manager [req-d5badc34-e549-4873-99ce-78dd909ec050 req-1685a788-63e1-4d55-a12c-e3f984418cd4 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received unexpected event network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e for instance with vm_state building and task_state spawning.
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:17:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:17:09 user nova-compute[73208]: INFO nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 16 09:17:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:09 user nova-compute[73208]: INFO nova.compute.manager [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Took 7.77 seconds to build instance.
Aug 16 09:17:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2ab674b5-7a9e-4acf-a8ff-7e1d9169f2d5 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "40bcc402-c1e2-441b-ae31-400a478ea272" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.955s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBpUEgvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:17:11 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:17:11 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:17:11 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76de0af-7590-441f-81c5-a22f11d34475]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:17:11 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fd4471-6795-496e-9c8c-e26b7c3cd30a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913] added
Aug 16 09:17:11 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc59a84-e9bd-43dd-873e-f917cb76afb1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d96c474-26e4-4431-b2b4-c1c74d0ccb49]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBpUEgvR {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBpUEgvR" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a2110-d758-4e68-8b96-4cdf0e875793]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LBpUEgvR'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fc0cdf-2bc4-4ee8-8d74-5d8b5af1bb3c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ded0d-67ef-47b7-8e88-f7d790b7b648]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:17:11 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:17:11 user nova-compute[73208]:  {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:17:11 user nova-compute[73208]: WARNING os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 09:17:11 user nova-compute[73208]: 
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3be78a-a37a-4216-b302-a1a7bb7c20c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913, portal: 172.16.0.220,3260]
Aug 16 09:17:11 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913, portal: 172.16.0.220,3260] successful.
Aug 16 09:17:11 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a5879-e87e-49a2-8a79-defeb32970ba]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadda88d-b6c5-4fc5-82ea-fe313c009ea9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 (non-flash)
Aug 16 09:17:11 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 (non-flash)
Aug 16 09:17:11 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8035b987-6cf0-4838-9dfb-2bdf5f36e6cb]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:17:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBpUEgvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:17:12 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:17:12 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23136363163313331', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:17:12 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136363163313331', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:17:12 user nova-compute[73208]: DEBUG nova.objects.instance [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'flavor' on Instance uuid e8646f12-ea4a-4ba2-81e4-b4d9323f13ff {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:12 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:17:12 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:17:12 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:17:12 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:17:12 user nova-compute[73208]:   <serial>d1f9eafa-79e0-406c-b8a6-4e763ba21913</serial>
Aug 16 09:17:12 user nova-compute[73208]: </disk>
Aug 16 09:17:12 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:17:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:17:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:17:13 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No VIF found with MAC fa:16:3e:a8:83:ff, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:17:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-388c5350-6d24-4157-83d0-d5692aedc5d6 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.779s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:15 user nova-compute[73208]: INFO nova.compute.manager [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Detaching volume d1f9eafa-79e0-406c-b8a6-4e763ba21913
Aug 16 09:17:15 user nova-compute[73208]: INFO nova.virt.block_device [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Attempting to driver detach volume d1f9eafa-79e0-406c-b8a6-4e763ba21913 from mountpoint /dev/vdb
Aug 16 09:17:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Attempting to detach device vdb from instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:17:15 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:17:15 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:17:15 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:17:15 user nova-compute[73208]:   <serial>d1f9eafa-79e0-406c-b8a6-4e763ba21913</serial>
Aug 16 09:17:15 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:17:15 user nova-compute[73208]: </disk>
Aug 16 09:17:15 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:17:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Successfully detached device vdb from instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff from the persistent domain config.
Aug 16 09:17:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:17:15 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:17:15 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:17:15 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:17:15 user nova-compute[73208]:   <serial>d1f9eafa-79e0-406c-b8a6-4e763ba21913</serial>
Aug 16 09:17:15 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:17:15 user nova-compute[73208]: </disk>
Aug 16 09:17:15 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177435.8530033, e8646f12-ea4a-4ba2-81e4-b4d9323f13ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:17:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Successfully detached device vdb from instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff from the live domain config.
Aug 16 09:17:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBpUEgvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:17:15 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c47acf6-a2ef-4718-821c-9d9237260aa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d7962-0ad4-4505-9477-1b831ffe6270]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 (non-flash)
Aug 16 09:17:15 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 (non-flash)
Aug 16 09:17:15 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f00f37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a122920-6e24-4d95-8735-aa3c4a35fbc8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ff0894-13e0-4e0e-8129-b9805c63899a]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d200f3-af14-4607-88b7-4dc197afc5c7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:17:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b3301b-bc57-42c6-b265-4969e38dea3b]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c79acd-6863-4092-9e30-47d790f148f9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[58299c58-5643-4e71-8491-6e57b9d039f3]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913, portal: 172.16.0.220,3260]
Aug 16 09:17:16 user nova-compute[73208]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913, portal: 172.16.0.220,3260] successful.
Aug 16 09:17:16 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f9eafa-79e0-406c-b8a6-4e763ba21913 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d19883-2407-4b72-aebb-028df472945b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] <== disconnect_volume: return (246ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'flavor' on Instance uuid e8646f12-ea4a-4ba2-81e4-b4d9323f13ff {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6db1729c-dcd3-49bf-b4b2-97a2ed24dc4f tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.651s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:19 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:21 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:17:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:24 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:24 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7749MB free_disk=25.621658325195312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e136b8e0-df33-45bb-9444-191dcd24bdd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 40bcc402-c1e2-441b-ae31-400a478ea272 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:17:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:17:25 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:17:25 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:17:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:25 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:17:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:17:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:17:28 user nova-compute[73208]: INFO nova.compute.claims [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Claim successful on node user
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:17:29 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.policy [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '440128c7fc3046068e7020c70ffb25d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4186d2c7f14b4ab3010a7302f5f1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:17:29 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Creating image(s)
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "/opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "/opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk 1073741824" returned: 0 in 0.071s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Successfully created port: 86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:17:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Cannot resize image /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'migration_context' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Ensure instance console log exists: /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Successfully updated port: 86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-74720012-1960-4907-9baf-1c2901b9e589 req-1e082df6-e183-4b89-9077-9b57252b9885 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received event network-changed-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-74720012-1960-4907-9baf-1c2901b9e589 req-1e082df6-e183-4b89-9077-9b57252b9885 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Refreshing instance network info cache due to event network-changed-86f553fb-85d6-4c04-8b94-cee199b10140. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74720012-1960-4907-9baf-1c2901b9e589 req-1e082df6-e183-4b89-9077-9b57252b9885 service nova] Acquiring lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74720012-1960-4907-9baf-1c2901b9e589 req-1e082df6-e183-4b89-9077-9b57252b9885 service nova] Acquired lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.network.neutron [req-74720012-1960-4907-9baf-1c2901b9e589 req-1e082df6-e183-4b89-9077-9b57252b9885 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Refreshing network info cache for port 86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:17:30 user nova-compute[73208]: DEBUG nova.network.neutron [req-74720012-1960-4907-9baf-1c2901b9e589 req-1e082df6-e183-4b89-9077-9b57252b9885 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.network.neutron [req-74720012-1960-4907-9baf-1c2901b9e589 req-1e082df6-e183-4b89-9077-9b57252b9885 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74720012-1960-4907-9baf-1c2901b9e589 req-1e082df6-e183-4b89-9077-9b57252b9885 service nova] Releasing lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquired lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Updating instance_info_cache with network_info: [{"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Releasing lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Instance network_info: |[{"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Start _get_guest_xml network_info=[{"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:17:31 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:31 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347418240',display_name='tempest-AttachVolumeTestJSON-server-1347418240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347418240',id=23,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Jqql4F1owI7lSmZzdKeQ3rCNk/f0y3b6jT6fD7JBzIPKvYjMmQSabQgsnEQ8XCZEX+7ABVYGaAx4J4H3wZTfEnVsLtEmPsTXRyNyuo+BpT5CxTPZmLYunV3GIuBFAVA==',key_name='tempest-keypair-1164260768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-srw4w8u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=ae51bc16-0b87-47cd-9b37-e0a2201b4479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=86f553fb-85d6-4c04-8b94-cee199b10140,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f553fb-85') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'pci_devices' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:17:31 user nova-compute[73208]:   <uuid>ae51bc16-0b87-47cd-9b37-e0a2201b4479</uuid>
Aug 16 09:17:31 user nova-compute[73208]:   <name>instance-00000017</name>
Aug 16 09:17:31 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:17:31 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:17:31 user nova-compute[73208]:   <metadata>
Aug 16 09:17:31 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:17:31 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:17:31 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeTestJSON-server-1347418240</nova:name>
Aug 16 09:17:31 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:17:31</nova:creationTime>
Aug 16 09:17:31 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:17:31 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:17:31 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:17:31 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:17:31 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:17:31 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:17:31 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:17:31 user nova-compute[73208]:       <nova:owner>
Aug 16 09:17:31 user nova-compute[73208]:         <nova:user uuid="440128c7fc3046068e7020c70ffb25d9">tempest-AttachVolumeTestJSON-60014534-project-member</nova:user>
Aug 16 09:17:31 user nova-compute[73208]:         <nova:project uuid="9e4186d2c7f14b4ab3010a7302f5f1d3">tempest-AttachVolumeTestJSON-60014534</nova:project>
Aug 16 09:17:31 user nova-compute[73208]:       </nova:owner>
Aug 16 09:17:31 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:17:31 user nova-compute[73208]:       <nova:ports>
Aug 16 09:17:31 user nova-compute[73208]:         <nova:port uuid="86f553fb-85d6-4c04-8b94-cee199b10140">
Aug 16 09:17:31 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 09:17:31 user nova-compute[73208]:         </nova:port>
Aug 16 09:17:31 user nova-compute[73208]:       </nova:ports>
Aug 16 09:17:31 user nova-compute[73208]:     </nova:instance>
Aug 16 09:17:31 user nova-compute[73208]:   </metadata>
Aug 16 09:17:31 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:17:31 user nova-compute[73208]:     <system>
Aug 16 09:17:31 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:17:31 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:17:31 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:17:31 user nova-compute[73208]:       <entry name="serial">ae51bc16-0b87-47cd-9b37-e0a2201b4479</entry>
Aug 16 09:17:31 user nova-compute[73208]:       <entry name="uuid">ae51bc16-0b87-47cd-9b37-e0a2201b4479</entry>
Aug 16 09:17:31 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:17:31 user nova-compute[73208]:     </system>
Aug 16 09:17:31 user nova-compute[73208]:   </sysinfo>
Aug 16 09:17:31 user nova-compute[73208]:   <os>
Aug 16 09:17:31 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:17:31 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:17:31 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:17:31 user nova-compute[73208]:   </os>
Aug 16 09:17:31 user nova-compute[73208]:   <features>
Aug 16 09:17:31 user nova-compute[73208]:     <acpi/>
Aug 16 09:17:31 user nova-compute[73208]:     <apic/>
Aug 16 09:17:31 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:17:31 user nova-compute[73208]:   </features>
Aug 16 09:17:31 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:17:31 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:17:31 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:17:31 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:17:31 user nova-compute[73208]:   </clock>
Aug 16 09:17:31 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:17:31 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:17:31 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:17:31 user nova-compute[73208]:   </cpu>
Aug 16 09:17:31 user nova-compute[73208]:   <devices>
Aug 16 09:17:31 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:17:31 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:17:31 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk"/>
Aug 16 09:17:31 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:17:31 user nova-compute[73208]:     </disk>
Aug 16 09:17:31 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:17:31 user nova-compute[73208]:       <mac address="fa:16:3e:09:2d:24"/>
Aug 16 09:17:31 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:17:31 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:17:31 user nova-compute[73208]:       <target dev="tap86f553fb-85"/>
Aug 16 09:17:31 user nova-compute[73208]:     </interface>
Aug 16 09:17:31 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:17:31 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/console.log" append="off"/>
Aug 16 09:17:31 user nova-compute[73208]:     </serial>
Aug 16 09:17:31 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:17:31 user nova-compute[73208]:     <video>
Aug 16 09:17:31 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:17:31 user nova-compute[73208]:     </video>
Aug 16 09:17:31 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:17:31 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:17:31 user nova-compute[73208]:     </rng>
Aug 16 09:17:31 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:17:31 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:17:31 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:17:31 user nova-compute[73208]:     </memballoon>
Aug 16 09:17:31 user nova-compute[73208]:   </devices>
Aug 16 09:17:31 user nova-compute[73208]: </domain>
Aug 16 09:17:31 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347418240',display_name='tempest-AttachVolumeTestJSON-server-1347418240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347418240',id=23,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Jqql4F1owI7lSmZzdKeQ3rCNk/f0y3b6jT6fD7JBzIPKvYjMmQSabQgsnEQ8XCZEX+7ABVYGaAx4J4H3wZTfEnVsLtEmPsTXRyNyuo+BpT5CxTPZmLYunV3GIuBFAVA==',key_name='tempest-keypair-1164260768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-srw4w8u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=ae51bc16-0b87-47cd-9b37-e0a2201b4479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=86f553fb-85d6-4c04-8b94-cee199b10140,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f553fb-85') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG os_vif [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=86f553fb-85d6-4c04-8b94-cee199b10140,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f553fb-85') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86f553fb-85, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86f553fb-85, col_values=(('external_ids', {'iface-id': '86f553fb-85d6-4c04-8b94-cee199b10140', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:2d:24', 'vm-uuid': 'ae51bc16-0b87-47cd-9b37-e0a2201b4479'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:31 user nova-compute[73208]: INFO os_vif [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=86f553fb-85d6-4c04-8b94-cee199b10140,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f553fb-85')
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:17:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No VIF found with MAC fa:16:3e:09:2d:24, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:17:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-8ec9d16d-4410-4db1-9562-32c4efcf70c9 req-c40f68c2-b60c-46e7-b7f8-d9b13a5cd2a1 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received event network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8ec9d16d-4410-4db1-9562-32c4efcf70c9 req-c40f68c2-b60c-46e7-b7f8-d9b13a5cd2a1 service nova] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8ec9d16d-4410-4db1-9562-32c4efcf70c9 req-c40f68c2-b60c-46e7-b7f8-d9b13a5cd2a1 service nova] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8ec9d16d-4410-4db1-9562-32c4efcf70c9 req-c40f68c2-b60c-46e7-b7f8-d9b13a5cd2a1 service nova] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-8ec9d16d-4410-4db1-9562-32c4efcf70c9 req-c40f68c2-b60c-46e7-b7f8-d9b13a5cd2a1 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] No waiting events found dispatching network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:17:33 user nova-compute[73208]: WARNING nova.compute.manager [req-8ec9d16d-4410-4db1-9562-32c4efcf70c9 req-c40f68c2-b60c-46e7-b7f8-d9b13a5cd2a1 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received unexpected event network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 for instance with vm_state building and task_state spawning.
Aug 16 09:17:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177455.0219731, ae51bc16-0b87-47cd-9b37-e0a2201b4479 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:17:35 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] VM Resumed (Lifecycle Event)
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:17:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Instance spawned successfully.
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:17:35 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177455.0235114, ae51bc16-0b87-47cd-9b37-e0a2201b4479 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:17:35 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] VM Started (Lifecycle Event)
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:17:35 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:17:35 user nova-compute[73208]: INFO nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-4c559e67-751a-410d-aa00-a1797b0b5395 req-7b910eb9-a0aa-456a-8878-7c0f42628aa2 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received event network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4c559e67-751a-410d-aa00-a1797b0b5395 req-7b910eb9-a0aa-456a-8878-7c0f42628aa2 service nova] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4c559e67-751a-410d-aa00-a1797b0b5395 req-7b910eb9-a0aa-456a-8878-7c0f42628aa2 service nova] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4c559e67-751a-410d-aa00-a1797b0b5395 req-7b910eb9-a0aa-456a-8878-7c0f42628aa2 service nova] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-4c559e67-751a-410d-aa00-a1797b0b5395 req-7b910eb9-a0aa-456a-8878-7c0f42628aa2 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] No waiting events found dispatching network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:17:35 user nova-compute[73208]: WARNING nova.compute.manager [req-4c559e67-751a-410d-aa00-a1797b0b5395 req-7b910eb9-a0aa-456a-8878-7c0f42628aa2 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received unexpected event network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 for instance with vm_state building and task_state spawning.
Aug 16 09:17:35 user nova-compute[73208]: INFO nova.compute.manager [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Took 6.59 seconds to build instance.
Aug 16 09:17:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bf082cf-d046-4f6a-a98c-a73fe59c3c25 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.685s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:36 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:17:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:17:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:17:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:47 user nova-compute[73208]: INFO nova.compute.manager [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Unshelving
Aug 16 09:17:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'pci_requests' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:17:47 user nova-compute[73208]: INFO nova.compute.claims [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Claim successful on node user
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:17:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:47 user nova-compute[73208]: INFO nova.network.neutron [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updating port dab0525e-3a3f-459a-a384-55f5ed6886e2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 09:17:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:17:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquired lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:17:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:17:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-36592c5c-3cb3-466b-a49d-cdef117543fc req-ba377ba2-aae4-45f9-aa15-765017800b83 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-changed-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-36592c5c-3cb3-466b-a49d-cdef117543fc req-ba377ba2-aae4-45f9-aa15-765017800b83 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Refreshing instance network info cache due to event network-changed-dab0525e-3a3f-459a-a384-55f5ed6886e2. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:17:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-36592c5c-3cb3-466b-a49d-cdef117543fc req-ba377ba2-aae4-45f9-aa15-765017800b83 service nova] Acquiring lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updating instance_info_cache with network_info: [{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Releasing lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:17:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Creating image(s)
Aug 16 09:17:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-36592c5c-3cb3-466b-a49d-cdef117543fc req-ba377ba2-aae4-45f9-aa15-765017800b83 service nova] Acquired lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-36592c5c-3cb3-466b-a49d-cdef117543fc req-ba377ba2-aae4-45f9-aa15-765017800b83 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Refreshing network info cache for port dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "dcd6105791e12a5760b1b7f69e47dcb68976a2a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "dcd6105791e12a5760b1b7f69e47dcb68976a2a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0.part --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG nova.virt.images [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] 258e5dea-0007-40bb-86ba-40ebf1ff833c was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0.part /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG nova.network.neutron [req-36592c5c-3cb3-466b-a49d-cdef117543fc req-ba377ba2-aae4-45f9-aa15-765017800b83 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updated VIF entry in instance network info cache for port dab0525e-3a3f-459a-a384-55f5ed6886e2. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG nova.network.neutron [req-36592c5c-3cb3-466b-a49d-cdef117543fc req-ba377ba2-aae4-45f9-aa15-765017800b83 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updating instance_info_cache with network_info: [{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-36592c5c-3cb3-466b-a49d-cdef117543fc req-ba377ba2-aae4-45f9-aa15-765017800b83 service nova] Releasing lock "refresh_cache-8b1e6b82-35a8-44fe-ad1b-35b146491287" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0.part /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0.converted" returned: 0 in 0.337s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "dcd6105791e12a5760b1b7f69e47dcb68976a2a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.829s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0 --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "dcd6105791e12a5760b1b7f69e47dcb68976a2a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "dcd6105791e12a5760b1b7f69e47dcb68976a2a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0 --force-share --output=json" returned: 0 in 0.216s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0,backing_fmt=raw /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0,backing_fmt=raw /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk 1073741824" returned: 0 in 0.085s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "dcd6105791e12a5760b1b7f69e47dcb68976a2a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0 --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'migration_context' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Rebasing disk image.
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 -F raw /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:53 user nova-compute[73208]: INFO nova.compute.manager [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] instance snapshotting
Aug 16 09:17:53 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Beginning live snapshot process
Aug 16 09:17:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json -f qcow2 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 -F raw /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk" returned: 0 in 2.305s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Ensure instance console log exists: /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Start _get_guest_xml network_info=[{"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7b0a479a077426333c6441a4d386be8a',container_format='bare',created_at=2023-08-16T09:15:55Z,direct_url=<?>,disk_format='qcow2',id=258e5dea-0007-40bb-86ba-40ebf1ff833c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-548090255-shelved',owner='05e96874fcad4d3b8fcd66f3f513b13d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T09:15:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json -f qcow2" returned: 0 in 0.259s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json -f qcow2 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:54 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:54 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7b0a479a077426333c6441a4d386be8a',container_format='bare',created_at=2023-08-16T09:15:55Z,direct_url=<?>,disk_format='qcow2',id=258e5dea-0007-40bb-86ba-40ebf1ff833c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-548090255-shelved',owner='05e96874fcad4d3b8fcd66f3f513b13d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T09:15:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-548090255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-548090255',id=16,image_ref='258e5dea-0007-40bb-86ba-40ebf1ff833c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1890426223',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:14:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-qwm6ltdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member',shelved_at='2023-08-16T09:15:58.699801',shelved_host='user',shelved_image_id='258e5dea-0007-40bb-86ba-40ebf1ff833c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:17:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b1e6b82-35a8-44fe-ad1b-35b146491287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:17:54 user nova-compute[73208]:   <uuid>8b1e6b82-35a8-44fe-ad1b-35b146491287</uuid>
Aug 16 09:17:54 user nova-compute[73208]:   <name>instance-00000010</name>
Aug 16 09:17:54 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:17:54 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:17:54 user nova-compute[73208]:   <metadata>
Aug 16 09:17:54 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:17:54 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:17:54 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-548090255</nova:name>
Aug 16 09:17:54 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:17:54</nova:creationTime>
Aug 16 09:17:54 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:17:54 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:17:54 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:17:54 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:17:54 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:17:54 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:17:54 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:17:54 user nova-compute[73208]:       <nova:owner>
Aug 16 09:17:54 user nova-compute[73208]:         <nova:user uuid="858c944850cd4fe69b6c8f782cae394a">tempest-AttachVolumeShelveTestJSON-1142897180-project-member</nova:user>
Aug 16 09:17:54 user nova-compute[73208]:         <nova:project uuid="05e96874fcad4d3b8fcd66f3f513b13d">tempest-AttachVolumeShelveTestJSON-1142897180</nova:project>
Aug 16 09:17:54 user nova-compute[73208]:       </nova:owner>
Aug 16 09:17:54 user nova-compute[73208]:       <nova:root type="image" uuid="258e5dea-0007-40bb-86ba-40ebf1ff833c"/>
Aug 16 09:17:54 user nova-compute[73208]:       <nova:ports>
Aug 16 09:17:54 user nova-compute[73208]:         <nova:port uuid="dab0525e-3a3f-459a-a384-55f5ed6886e2">
Aug 16 09:17:54 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:17:54 user nova-compute[73208]:         </nova:port>
Aug 16 09:17:54 user nova-compute[73208]:       </nova:ports>
Aug 16 09:17:54 user nova-compute[73208]:     </nova:instance>
Aug 16 09:17:54 user nova-compute[73208]:   </metadata>
Aug 16 09:17:54 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:17:54 user nova-compute[73208]:     <system>
Aug 16 09:17:54 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:17:54 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:17:54 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:17:54 user nova-compute[73208]:       <entry name="serial">8b1e6b82-35a8-44fe-ad1b-35b146491287</entry>
Aug 16 09:17:54 user nova-compute[73208]:       <entry name="uuid">8b1e6b82-35a8-44fe-ad1b-35b146491287</entry>
Aug 16 09:17:54 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:17:54 user nova-compute[73208]:     </system>
Aug 16 09:17:54 user nova-compute[73208]:   </sysinfo>
Aug 16 09:17:54 user nova-compute[73208]:   <os>
Aug 16 09:17:54 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:17:54 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:17:54 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:17:54 user nova-compute[73208]:   </os>
Aug 16 09:17:54 user nova-compute[73208]:   <features>
Aug 16 09:17:54 user nova-compute[73208]:     <acpi/>
Aug 16 09:17:54 user nova-compute[73208]:     <apic/>
Aug 16 09:17:54 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:17:54 user nova-compute[73208]:   </features>
Aug 16 09:17:54 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:17:54 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:17:54 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:17:54 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:17:54 user nova-compute[73208]:   </clock>
Aug 16 09:17:54 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:17:54 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:17:54 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:17:54 user nova-compute[73208]:   </cpu>
Aug 16 09:17:54 user nova-compute[73208]:   <devices>
Aug 16 09:17:54 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:17:54 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:17:54 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk"/>
Aug 16 09:17:54 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:17:54 user nova-compute[73208]:     </disk>
Aug 16 09:17:54 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:17:54 user nova-compute[73208]:       <mac address="fa:16:3e:66:bc:32"/>
Aug 16 09:17:54 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:17:54 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:17:54 user nova-compute[73208]:       <target dev="tapdab0525e-3a"/>
Aug 16 09:17:54 user nova-compute[73208]:     </interface>
Aug 16 09:17:54 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:17:54 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/console.log" append="off"/>
Aug 16 09:17:54 user nova-compute[73208]:     </serial>
Aug 16 09:17:54 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:17:54 user nova-compute[73208]:     <video>
Aug 16 09:17:54 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:17:54 user nova-compute[73208]:     </video>
Aug 16 09:17:54 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:17:54 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:17:54 user nova-compute[73208]:     </rng>
Aug 16 09:17:54 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:17:54 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:17:54 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:17:54 user nova-compute[73208]:     </memballoon>
Aug 16 09:17:54 user nova-compute[73208]:   </devices>
Aug 16 09:17:54 user nova-compute[73208]: </domain>
Aug 16 09:17:54 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-548090255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-548090255',id=16,image_ref='258e5dea-0007-40bb-86ba-40ebf1ff833c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1890426223',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:14:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-qwm6ltdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member',shelved_at='2023-08-16T09:15:58.699801',shelved_host='user',shelved_image_id='258e5dea-0007-40bb-86ba-40ebf1ff833c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:17:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b1e6b82-35a8-44fe-ad1b-35b146491287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG os_vif [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdab0525e-3a, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdab0525e-3a, col_values=(('external_ids', {'iface-id': 'dab0525e-3a3f-459a-a384-55f5ed6886e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:bc:32', 'vm-uuid': '8b1e6b82-35a8-44fe-ad1b-35b146491287'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:17:54 user nova-compute[73208]: INFO os_vif [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a')
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] No VIF found with MAC fa:16:3e:66:bc:32, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt3i9d8ci/6f14e442d95249f5baee8406caba87c5.delta 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt3i9d8ci/6f14e442d95249f5baee8406caba87c5.delta 1073741824" returned: 0 in 0.049s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 09:17:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:17:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 09:17:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt3i9d8ci/6f14e442d95249f5baee8406caba87c5.delta /opt/stack/data/nova/instances/snapshots/tmpt3i9d8ci/6f14e442d95249f5baee8406caba87c5 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-de9b414f-67f8-48a0-807c-82ce2e954b58 req-afe974ef-8f13-4824-918f-43f65141cef0 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-de9b414f-67f8-48a0-807c-82ce2e954b58 req-afe974ef-8f13-4824-918f-43f65141cef0 service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-de9b414f-67f8-48a0-807c-82ce2e954b58 req-afe974ef-8f13-4824-918f-43f65141cef0 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-de9b414f-67f8-48a0-807c-82ce2e954b58 req-afe974ef-8f13-4824-918f-43f65141cef0 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-de9b414f-67f8-48a0-807c-82ce2e954b58 req-afe974ef-8f13-4824-918f-43f65141cef0 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:17:56 user nova-compute[73208]: WARNING nova.compute.manager [req-de9b414f-67f8-48a0-807c-82ce2e954b58 req-afe974ef-8f13-4824-918f-43f65141cef0 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 09:17:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt3i9d8ci/6f14e442d95249f5baee8406caba87c5.delta /opt/stack/data/nova/instances/snapshots/tmpt3i9d8ci/6f14e442d95249f5baee8406caba87c5" returned: 0 in 0.380s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:17:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Snapshot extracted, beginning image upload
Aug 16 09:17:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177478.6508887, 8b1e6b82-35a8-44fe-ad1b-35b146491287 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:17:58 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] VM Resumed (Lifecycle Event)
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:17:58 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance spawned successfully.
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:17:58 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177478.6525102, 8b1e6b82-35a8-44fe-ad1b-35b146491287 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:17:58 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] VM Started (Lifecycle Event)
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:17:58 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-40db4d5f-d8fc-49ab-b489-b71de1aa5815 req-ec3b40ea-2755-410a-a1ce-83d4880013ca service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40db4d5f-d8fc-49ab-b489-b71de1aa5815 req-ec3b40ea-2755-410a-a1ce-83d4880013ca service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40db4d5f-d8fc-49ab-b489-b71de1aa5815 req-ec3b40ea-2755-410a-a1ce-83d4880013ca service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-40db4d5f-d8fc-49ab-b489-b71de1aa5815 req-ec3b40ea-2755-410a-a1ce-83d4880013ca service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-40db4d5f-d8fc-49ab-b489-b71de1aa5815 req-ec3b40ea-2755-410a-a1ce-83d4880013ca service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:17:58 user nova-compute[73208]: WARNING nova.compute.manager [req-40db4d5f-d8fc-49ab-b489-b71de1aa5815 req-ec3b40ea-2755-410a-a1ce-83d4880013ca service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 09:17:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:17:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d21f2660-523d-4039-ba66-9fba779294dc tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.776s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:17:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Snapshot image upload complete
Aug 16 09:17:59 user nova-compute[73208]: INFO nova.compute.manager [None req-7664071c-9a2e-49e0-94d7-516e18293588 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Took 5.51 seconds to snapshot the instance on the hypervisor.
Aug 16 09:17:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:12 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:18:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:12 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:18:12 user nova-compute[73208]: INFO nova.compute.claims [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Claim successful on node user
Aug 16 09:18:13 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:18:13 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:18:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:18:13 user nova-compute[73208]: INFO nova.virt.block_device [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Booting with volume 81c53afb-aecc-422f-a2cb-332d0dbf6cb6 at /dev/vda
Aug 16 09:18:13 user nova-compute[73208]: DEBUG nova.policy [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e351e35970aa48028ad400bbda5403b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62017e5fe324a528f4ad1dc5c939498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG os_brick.utils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ffd4e2-10f5-4de2-b2a0-f7a6deb04330]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[116fc090-2d93-4819-a811-abf5e31cb334]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[58252899-4a93-4ed2-81ad-63da56ac1745]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[94682d12-c7e2-4eaa-8896-8428afbb218d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:18:13 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:18:13 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7868ab8-94bd-40a5-88ec-785857022f36]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG os_brick.utils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating existing volume attachment record: b4f15567-31c9-48c9-b249-72b630942ff4 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:18:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:14 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Successfully created port: 1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:18:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:15 user nova-compute[73208]: INFO nova.compute.manager [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] instance snapshotting
Aug 16 09:18:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Beginning live snapshot process
Aug 16 09:18:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Successfully updated port: 1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json -f qcow2 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquired lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-e85c2e62-2f48-4311-b29e-b74b486dc8e3 req-4181f54f-201a-4f98-abad-91120426a35c service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-changed-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-e85c2e62-2f48-4311-b29e-b74b486dc8e3 req-4181f54f-201a-4f98-abad-91120426a35c service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Refreshing instance network info cache due to event network-changed-1bc92838-8385-428d-a6cb-ddecf30e8c2b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e85c2e62-2f48-4311-b29e-b74b486dc8e3 req-4181f54f-201a-4f98-abad-91120426a35c service nova] Acquiring lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json -f qcow2 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating instance_info_cache with network_info: [{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Releasing lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance network_info: |[{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e85c2e62-2f48-4311-b29e-b74b486dc8e3 req-4181f54f-201a-4f98-abad-91120426a35c service nova] Acquired lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG nova.network.neutron [req-e85c2e62-2f48-4311-b29e-b74b486dc8e3 req-4181f54f-201a-4f98-abad-91120426a35c service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Refreshing network info cache for port 1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzdu4yozu/bd864be00e3a4db3b402a1cf4837bee0.delta 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzdu4yozu/bd864be00e3a4db3b402a1cf4837bee0.delta 1073741824" returned: 0 in 0.051s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 09:18:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-e85c2e62-2f48-4311-b29e-b74b486dc8e3 req-4181f54f-201a-4f98-abad-91120426a35c service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updated VIF entry in instance network info cache for port 1bc92838-8385-428d-a6cb-ddecf30e8c2b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:18:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-e85c2e62-2f48-4311-b29e-b74b486dc8e3 req-4181f54f-201a-4f98-abad-91120426a35c service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating instance_info_cache with network_info: [{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e85c2e62-2f48-4311-b29e-b74b486dc8e3 req-4181f54f-201a-4f98-abad-91120426a35c service nova] Releasing lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:18:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:18:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:18:17 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 09:18:17 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:18:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzdu4yozu/bd864be00e3a4db3b402a1cf4837bee0.delta /opt/stack/data/nova/instances/snapshots/tmpzdu4yozu/bd864be00e3a4db3b402a1cf4837bee0 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzdu4yozu/bd864be00e3a4db3b402a1cf4837bee0.delta /opt/stack/data/nova/instances/snapshots/tmpzdu4yozu/bd864be00e3a4db3b402a1cf4837bee0" returned: 0 in 0.287s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:17 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Snapshot extracted, beginning image upload
Aug 16 09:18:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:20 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Snapshot image upload complete
Aug 16 09:18:20 user nova-compute[73208]: INFO nova.compute.manager [None req-34a3b667-a705-454d-b131-d59e6084a155 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Took 5.25 seconds to snapshot the instance on the hypervisor.
Aug 16 09:18:21 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:18:22 user nova-compute[73208]: INFO nova.compute.claims [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Claim successful on node user
Aug 16 09:18:22 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:23 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.policy [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b7f7948212d4084b5599646e2486136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deeb19a8593540b48b0954bad0f1a0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:18:23 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Creating image(s)
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "/opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "/opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "/opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:18:23 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Creating image(s)
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Ensure instance console log exists: /opt/stack/data/nova/instances/00e2e59e-60e2-4833-8ca1-26a41dad5ea1/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Start _get_guest_xml network_info=[{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'b4f15567-31c9-48c9-b249-72b630942ff4', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tESfwzTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00e2e59e-60e2-4833-8ca1-26a41dad5ea1', 'attached_at': '', 'detached_at': '', 'volume_id': '81c53afb-aecc-422f-a2cb-332d0dbf6cb6', 'serial': '81c53afb-aecc-422f-a2cb-332d0dbf6cb6'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:18:23 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:18:23 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tESfwzTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:18:23 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:18:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:18:23 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:18:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:18:23 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d253b03d-8444-42ad-a109-2a75272a2334]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:18:23 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dfd7f0-2d4c-4d4f-ab82-faa45b7eee53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6] added
Aug 16 09:18:23 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7f3537-3903-43f1-a3cc-249b2c9512bf]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Successfully created port: d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.863s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[66db3e35-5d6d-4b09-b0de-a203518552a8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tESfwzTP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tESfwzTP" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed8120-cba8-4592-ad52-7e443401b2b8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tESfwzTP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f260b-bcc3-48d5-964b-3f1e0f75c60a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a62dc-7854-441e-88f4-abb0ab2654be]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:18:24 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:18:24 user nova-compute[73208]:  {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:18:24 user nova-compute[73208]: WARNING os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 09:18:24 user nova-compute[73208]: 
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94.part --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG nova.virt.images [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] 8aefa061-2d4f-4cb2-aa4f-f4e0509c7955 was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94.part /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca584be-38c5-412a-9c4d-d1703b2538ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260]
Aug 16 09:18:24 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260] successful.
Aug 16 09:18:24 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:18:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f91a5-c33d-426c-8294-c179b778a225]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a73675-eb27-47dd-b56a-fcf72ae6a26f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:18:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:18:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc7af0-147f-41bf-ac07-f25a1cf8c9d5]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tESfwzTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94.part /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94.converted" returned: 0 in 0.313s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.656s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Successfully updated port: d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-b7b778f0-ff19-4d7c-9c04-4a353fef215f req-248372bc-ca18-464a-9220-b0ffe06341ca service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-changed-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-b7b778f0-ff19-4d7c-9c04-4a353fef215f req-248372bc-ca18-464a-9220-b0ffe06341ca service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Refreshing instance network info cache due to event network-changed-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b7b778f0-ff19-4d7c-9c04-4a353fef215f req-248372bc-ca18-464a-9220-b0ffe06341ca service nova] Acquiring lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b7b778f0-ff19-4d7c-9c04-4a353fef215f req-248372bc-ca18-464a-9220-b0ffe06341ca service nova] Acquired lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG nova.network.neutron [req-b7b778f0-ff19-4d7c-9c04-4a353fef215f req-248372bc-ca18-464a-9220-b0ffe06341ca service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Refreshing network info cache for port d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94 --force-share --output=json" returned: 0 in 0.199s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG nova.network.neutron [req-b7b778f0-ff19-4d7c-9c04-4a353fef215f req-248372bc-ca18-464a-9220-b0ffe06341ca service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94 --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94,backing_fmt=raw /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94,backing_fmt=raw /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk 1073741824" returned: 0 in 0.066s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG nova.network.neutron [req-b7b778f0-ff19-4d7c-9c04-4a353fef215f req-248372bc-ca18-464a-9220-b0ffe06341ca service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b7b778f0-ff19-4d7c-9c04-4a353fef215f req-248372bc-ca18-464a-9220-b0ffe06341ca service nova] Releasing lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquired lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.220s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== connect_volume: return (2223ms) {'type': 'block', 'scsi_wwn': '23766343133393938', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766343133393938', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94 --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'migration_context' on Instance uuid 294850cd-624e-45df-b26b-18981a4ef2f2 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Ensure instance console log exists: /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1569928669',display_name='tempest-ServerActionsTestOtherA-server-1569928669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1569928669',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-sfnlvq70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=00e2e59e-60e2-4833-8ca1-26a41dad5ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'pci_devices' on Instance uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:18:26 user nova-compute[73208]:   <uuid>00e2e59e-60e2-4833-8ca1-26a41dad5ea1</uuid>
Aug 16 09:18:26 user nova-compute[73208]:   <name>instance-00000018</name>
Aug 16 09:18:26 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:18:26 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:18:26 user nova-compute[73208]:   <metadata>
Aug 16 09:18:26 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:18:26 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:name>tempest-ServerActionsTestOtherA-server-1569928669</nova:name>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:18:23</nova:creationTime>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:18:26 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:18:26 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:owner>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:user uuid="e351e35970aa48028ad400bbda5403b1">tempest-ServerActionsTestOtherA-1386845270-project-member</nova:user>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:project uuid="d62017e5fe324a528f4ad1dc5c939498">tempest-ServerActionsTestOtherA-1386845270</nova:project>
Aug 16 09:18:26 user nova-compute[73208]:       </nova:owner>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:ports>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:port uuid="1bc92838-8385-428d-a6cb-ddecf30e8c2b">
Aug 16 09:18:26 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 09:18:26 user nova-compute[73208]:         </nova:port>
Aug 16 09:18:26 user nova-compute[73208]:       </nova:ports>
Aug 16 09:18:26 user nova-compute[73208]:     </nova:instance>
Aug 16 09:18:26 user nova-compute[73208]:   </metadata>
Aug 16 09:18:26 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:18:26 user nova-compute[73208]:     <system>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="serial">00e2e59e-60e2-4833-8ca1-26a41dad5ea1</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="uuid">00e2e59e-60e2-4833-8ca1-26a41dad5ea1</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:18:26 user nova-compute[73208]:     </system>
Aug 16 09:18:26 user nova-compute[73208]:   </sysinfo>
Aug 16 09:18:26 user nova-compute[73208]:   <os>
Aug 16 09:18:26 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:18:26 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:18:26 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:18:26 user nova-compute[73208]:   </os>
Aug 16 09:18:26 user nova-compute[73208]:   <features>
Aug 16 09:18:26 user nova-compute[73208]:     <acpi/>
Aug 16 09:18:26 user nova-compute[73208]:     <apic/>
Aug 16 09:18:26 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:18:26 user nova-compute[73208]:   </features>
Aug 16 09:18:26 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:18:26 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:18:26 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:18:26 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:18:26 user nova-compute[73208]:   </clock>
Aug 16 09:18:26 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:18:26 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:18:26 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:18:26 user nova-compute[73208]:   </cpu>
Aug 16 09:18:26 user nova-compute[73208]:   <devices>
Aug 16 09:18:26 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:18:26 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:18:26 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:18:26 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:18:26 user nova-compute[73208]:       <serial>81c53afb-aecc-422f-a2cb-332d0dbf6cb6</serial>
Aug 16 09:18:26 user nova-compute[73208]:     </disk>
Aug 16 09:18:26 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:18:26 user nova-compute[73208]:       <mac address="fa:16:3e:fb:90:2c"/>
Aug 16 09:18:26 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:18:26 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:18:26 user nova-compute[73208]:       <target dev="tap1bc92838-83"/>
Aug 16 09:18:26 user nova-compute[73208]:     </interface>
Aug 16 09:18:26 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:18:26 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/00e2e59e-60e2-4833-8ca1-26a41dad5ea1/console.log" append="off"/>
Aug 16 09:18:26 user nova-compute[73208]:     </serial>
Aug 16 09:18:26 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:18:26 user nova-compute[73208]:     <video>
Aug 16 09:18:26 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:18:26 user nova-compute[73208]:     </video>
Aug 16 09:18:26 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:18:26 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:18:26 user nova-compute[73208]:     </rng>
Aug 16 09:18:26 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:18:26 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:18:26 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:18:26 user nova-compute[73208]:     </memballoon>
Aug 16 09:18:26 user nova-compute[73208]:   </devices>
Aug 16 09:18:26 user nova-compute[73208]: </domain>
Aug 16 09:18:26 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1569928669',display_name='tempest-ServerActionsTestOtherA-server-1569928669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1569928669',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-sfnlvq70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=00e2e59e-60e2-4833-8ca1-26a41dad5ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG os_vif [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bc92838-83, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1bc92838-83, col_values=(('external_ids', {'iface-id': '1bc92838-8385-428d-a6cb-ddecf30e8c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:90:2c', 'vm-uuid': '00e2e59e-60e2-4833-8ca1-26a41dad5ea1'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:26 user nova-compute[73208]: INFO os_vif [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83')
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No VIF found with MAC fa:16:3e:fb:90:2c, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updating instance_info_cache with network_info: [{"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Releasing lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Instance network_info: |[{"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Start _get_guest_xml network_info=[{"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0f44b65fa3a5927276557c5beb910f36',container_format='bare',created_at=2023-08-16T09:18:15Z,direct_url=<?>,disk_format='qcow2',id=8aefa061-2d4f-4cb2-aa4f-f4e0509c7955,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-908385614',owner='deeb19a8593540b48b0954bad0f1a0fb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T09:18:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '8aefa061-2d4f-4cb2-aa4f-f4e0509c7955'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:18:26 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:18:26 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0f44b65fa3a5927276557c5beb910f36',container_format='bare',created_at=2023-08-16T09:18:15Z,direct_url=<?>,disk_format='qcow2',id=8aefa061-2d4f-4cb2-aa4f-f4e0509c7955,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-908385614',owner='deeb19a8593540b48b0954bad0f1a0fb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T09:18:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-310032303',display_name='tempest-TestStampPattern-server-310032303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-310032303',id=25,image_ref='8aefa061-2d4f-4cb2-aa4f-f4e0509c7955',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFP34sDs4CLYmubLSC4kCMpHtWHceMAeRCdklXcRBkRvJzGIHCzM0kgKwFuU1BnHR9jMIwv0gvQmT5STpCWuKJTa9HncMQEEcyd0scFYwDrZm/j986rVnynsvKDg7Y+KA==',key_name='tempest-TestStampPattern-2113117152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deeb19a8593540b48b0954bad0f1a0fb',ramdisk_id='',reservation_id='r-eypd63so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e8646f12-ea4a-4ba2-81e4-b4d9323f13ff',image_min_disk='1',image_min_ram='0',image_owner_id='deeb19a8593540b48b0954bad0f1a0fb',image_owner_project_name='tempest-TestStampPattern-1918763131',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1918763131-project-member',image_user_id='5b7f7948212d4084b5599646e2486136',network_allocated='True',owner_project_name='tempest-TestStampPattern-1918763131',owner_user_name='tempest-TestStampPattern-1918763131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:18:24Z,user_data=None,user_id='5b7f7948212d4084b5599646e2486136',uuid=294850cd-624e-45df-b26b-18981a4ef2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converting VIF {"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:4e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1cc07-e2') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'pci_devices' on Instance uuid 294850cd-624e-45df-b26b-18981a4ef2f2 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:18:26 user nova-compute[73208]:   <uuid>294850cd-624e-45df-b26b-18981a4ef2f2</uuid>
Aug 16 09:18:26 user nova-compute[73208]:   <name>instance-00000019</name>
Aug 16 09:18:26 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:18:26 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:18:26 user nova-compute[73208]:   <metadata>
Aug 16 09:18:26 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:18:26 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:name>tempest-TestStampPattern-server-310032303</nova:name>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:18:26</nova:creationTime>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:18:26 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:18:26 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:owner>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:user uuid="5b7f7948212d4084b5599646e2486136">tempest-TestStampPattern-1918763131-project-member</nova:user>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:project uuid="deeb19a8593540b48b0954bad0f1a0fb">tempest-TestStampPattern-1918763131</nova:project>
Aug 16 09:18:26 user nova-compute[73208]:       </nova:owner>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:root type="image" uuid="8aefa061-2d4f-4cb2-aa4f-f4e0509c7955"/>
Aug 16 09:18:26 user nova-compute[73208]:       <nova:ports>
Aug 16 09:18:26 user nova-compute[73208]:         <nova:port uuid="d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf">
Aug 16 09:18:26 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 09:18:26 user nova-compute[73208]:         </nova:port>
Aug 16 09:18:26 user nova-compute[73208]:       </nova:ports>
Aug 16 09:18:26 user nova-compute[73208]:     </nova:instance>
Aug 16 09:18:26 user nova-compute[73208]:   </metadata>
Aug 16 09:18:26 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:18:26 user nova-compute[73208]:     <system>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="serial">294850cd-624e-45df-b26b-18981a4ef2f2</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="uuid">294850cd-624e-45df-b26b-18981a4ef2f2</entry>
Aug 16 09:18:26 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:18:26 user nova-compute[73208]:     </system>
Aug 16 09:18:26 user nova-compute[73208]:   </sysinfo>
Aug 16 09:18:26 user nova-compute[73208]:   <os>
Aug 16 09:18:26 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:18:26 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:18:26 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:18:26 user nova-compute[73208]:   </os>
Aug 16 09:18:26 user nova-compute[73208]:   <features>
Aug 16 09:18:26 user nova-compute[73208]:     <acpi/>
Aug 16 09:18:26 user nova-compute[73208]:     <apic/>
Aug 16 09:18:26 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:18:26 user nova-compute[73208]:   </features>
Aug 16 09:18:26 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:18:26 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:18:26 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:18:26 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:18:26 user nova-compute[73208]:   </clock>
Aug 16 09:18:26 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:18:26 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:18:26 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:18:26 user nova-compute[73208]:   </cpu>
Aug 16 09:18:26 user nova-compute[73208]:   <devices>
Aug 16 09:18:26 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:18:26 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:18:26 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk"/>
Aug 16 09:18:26 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:18:26 user nova-compute[73208]:     </disk>
Aug 16 09:18:26 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:18:26 user nova-compute[73208]:       <mac address="fa:16:3e:90:4e:9f"/>
Aug 16 09:18:26 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:18:26 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:18:26 user nova-compute[73208]:       <target dev="tapd3e1cc07-e2"/>
Aug 16 09:18:26 user nova-compute[73208]:     </interface>
Aug 16 09:18:26 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:18:26 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/console.log" append="off"/>
Aug 16 09:18:26 user nova-compute[73208]:     </serial>
Aug 16 09:18:26 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:18:26 user nova-compute[73208]:     <video>
Aug 16 09:18:26 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:18:26 user nova-compute[73208]:     </video>
Aug 16 09:18:26 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:18:26 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:18:26 user nova-compute[73208]:     </rng>
Aug 16 09:18:26 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:18:26 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:18:26 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:18:26 user nova-compute[73208]:     </memballoon>
Aug 16 09:18:26 user nova-compute[73208]:   </devices>
Aug 16 09:18:26 user nova-compute[73208]: </domain>
Aug 16 09:18:26 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-310032303',display_name='tempest-TestStampPattern-server-310032303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-310032303',id=25,image_ref='8aefa061-2d4f-4cb2-aa4f-f4e0509c7955',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFP34sDs4CLYmubLSC4kCMpHtWHceMAeRCdklXcRBkRvJzGIHCzM0kgKwFuU1BnHR9jMIwv0gvQmT5STpCWuKJTa9HncMQEEcyd0scFYwDrZm/j986rVnynsvKDg7Y+KA==',key_name='tempest-TestStampPattern-2113117152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deeb19a8593540b48b0954bad0f1a0fb',ramdisk_id='',reservation_id='r-eypd63so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e8646f12-ea4a-4ba2-81e4-b4d9323f13ff',image_min_disk='1',image_min_ram='0',image_owner_id='deeb19a8593540b48b0954bad0f1a0fb',image_owner_project_name='tempest-TestStampPattern-1918763131',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1918763131-project-member',image_user_id='5b7f7948212d4084b5599646e2486136',network_allocated='True',owner_project_name='tempest-TestStampPattern-1918763131',owner_user_name='tempest-TestStampPattern-1918763131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:18:24Z,user_data=None,user_id='5b7f7948212d4084b5599646e2486136',uuid=294850cd-624e-45df-b26b-18981a4ef2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converting VIF {"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:4e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1cc07-e2') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG os_vif [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:4e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1cc07-e2') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3e1cc07-e2, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3e1cc07-e2, col_values=(('external_ids', {'iface-id': 'd3e1cc07-e2d4-420b-80a7-7dc2cb0705cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:4e:9f', 'vm-uuid': '294850cd-624e-45df-b26b-18981a4ef2f2'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:26 user nova-compute[73208]: INFO os_vif [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:4e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1cc07-e2')
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No VIF found with MAC fa:16:3e:90:4e:9f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:27 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:18:27 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7514MB free_disk=25.437877655029297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e136b8e0-df33-45bb-9444-191dcd24bdd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 40bcc402-c1e2-441b-ae31-400a478ea272 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8b1e6b82-35a8-44fe-ad1b-35b146491287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 294850cd-624e-45df-b26b-18981a4ef2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:18:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "b83a461d-8a5b-497b-aa52-ce2165cddb78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:18:28 user nova-compute[73208]: INFO nova.compute.claims [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Claim successful on node user
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-7db29a98-e867-45e3-86ff-b08759dbdc4a req-b5bade88-e0c0-4dad-b42a-2720386d37d6 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7db29a98-e867-45e3-86ff-b08759dbdc4a req-b5bade88-e0c0-4dad-b42a-2720386d37d6 service nova] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7db29a98-e867-45e3-86ff-b08759dbdc4a req-b5bade88-e0c0-4dad-b42a-2720386d37d6 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7db29a98-e867-45e3-86ff-b08759dbdc4a req-b5bade88-e0c0-4dad-b42a-2720386d37d6 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-7db29a98-e867-45e3-86ff-b08759dbdc4a req-b5bade88-e0c0-4dad-b42a-2720386d37d6 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] No waiting events found dispatching network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:18:28 user nova-compute[73208]: WARNING nova.compute.manager [req-7db29a98-e867-45e3-86ff-b08759dbdc4a req-b5bade88-e0c0-4dad-b42a-2720386d37d6 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received unexpected event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b for instance with vm_state building and task_state spawning.
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:18:29 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:18:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG nova.policy [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e67935e80e5743359098d8ef555d4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71b4a11aa5d4e939c88c1e06f14abc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:18:29 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Creating image(s)
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "/opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "/opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "/opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.287s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.214s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Successfully created port: 6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk 1073741824" returned: 0 in 0.063s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:18:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Cannot resize image /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.objects.instance [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lazy-loading 'migration_context' on Instance uuid b83a461d-8a5b-497b-aa52-ce2165cddb78 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Ensure instance console log exists: /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Skipping network cache update for instance because it is Building. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Skipping network cache update for instance because it is Building. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Skipping network cache update for instance because it is Building. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid aeff110f-8cbd-480d-8654-b0daee121eb7 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Successfully updated port: 6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "refresh_cache-b83a461d-8a5b-497b-aa52-ce2165cddb78" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquired lock "refresh_cache-b83a461d-8a5b-497b-aa52-ce2165cddb78" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-3f13be3d-168a-4c68-852f-c315b2362c6d req-c862c021-738b-42f9-89ff-342b9f3e22b9 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received event network-changed-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-3f13be3d-168a-4c68-852f-c315b2362c6d req-c862c021-738b-42f9-89ff-342b9f3e22b9 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Refreshing instance network info cache due to event network-changed-6ed9db81-30c0-459c-81ea-97e32f33ab56. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3f13be3d-168a-4c68-852f-c315b2362c6d req-c862c021-738b-42f9-89ff-342b9f3e22b9 service nova] Acquiring lock "refresh_cache-b83a461d-8a5b-497b-aa52-ce2165cddb78" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] No waiting events found dispatching network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:18:30 user nova-compute[73208]: WARNING nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received unexpected event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b for instance with vm_state building and task_state spawning.
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] No waiting events found dispatching network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:18:30 user nova-compute[73208]: WARNING nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received unexpected event network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf for instance with vm_state building and task_state spawning.
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] No waiting events found dispatching network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:18:30 user nova-compute[73208]: WARNING nova.compute.manager [req-843687e2-6d10-4837-b617-25e2350c0456 req-a99092d0-e7a6-419c-bb33-73d623f3bd42 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received unexpected event network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf for instance with vm_state building and task_state spawning.
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:18:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.network.neutron [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Updating instance_info_cache with network_info: [{"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Releasing lock "refresh_cache-b83a461d-8a5b-497b-aa52-ce2165cddb78" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Instance network_info: |[{"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3f13be3d-168a-4c68-852f-c315b2362c6d req-c862c021-738b-42f9-89ff-342b9f3e22b9 service nova] Acquired lock "refresh_cache-b83a461d-8a5b-497b-aa52-ce2165cddb78" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.network.neutron [req-3f13be3d-168a-4c68-852f-c315b2362c6d req-c862c021-738b-42f9-89ff-342b9f3e22b9 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Refreshing network info cache for port 6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Start _get_guest_xml network_info=[{"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:18:31 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:18:31 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1400800670',display_name='tempest-ServersNegativeTestJSON-server-1400800670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1400800670',id=26,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b71b4a11aa5d4e939c88c1e06f14abc0',ramdisk_id='',reservation_id='r-r9m9y3lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-678223637',owner_user_name='tempest-ServersNegativeTestJSON-678223637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:18:29Z,user_data=None,user_id='e67935e80e5743359098d8ef555d4f72',uuid=b83a461d-8a5b-497b-aa52-ce2165cddb78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converting VIF {"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3d:bd,bridge_name='br-int',has_traffic_filtering=True,id=6ed9db81-30c0-459c-81ea-97e32f33ab56,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed9db81-30') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.objects.instance [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lazy-loading 'pci_devices' on Instance uuid b83a461d-8a5b-497b-aa52-ce2165cddb78 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:18:31 user nova-compute[73208]:   <uuid>b83a461d-8a5b-497b-aa52-ce2165cddb78</uuid>
Aug 16 09:18:31 user nova-compute[73208]:   <name>instance-0000001a</name>
Aug 16 09:18:31 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:18:31 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:18:31 user nova-compute[73208]:   <metadata>
Aug 16 09:18:31 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:18:31 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:18:31 user nova-compute[73208]:       <nova:name>tempest-ServersNegativeTestJSON-server-1400800670</nova:name>
Aug 16 09:18:31 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:18:31</nova:creationTime>
Aug 16 09:18:31 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:18:31 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:18:31 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:18:31 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:18:31 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:18:31 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:18:31 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:18:31 user nova-compute[73208]:       <nova:owner>
Aug 16 09:18:31 user nova-compute[73208]:         <nova:user uuid="e67935e80e5743359098d8ef555d4f72">tempest-ServersNegativeTestJSON-678223637-project-member</nova:user>
Aug 16 09:18:31 user nova-compute[73208]:         <nova:project uuid="b71b4a11aa5d4e939c88c1e06f14abc0">tempest-ServersNegativeTestJSON-678223637</nova:project>
Aug 16 09:18:31 user nova-compute[73208]:       </nova:owner>
Aug 16 09:18:31 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:18:31 user nova-compute[73208]:       <nova:ports>
Aug 16 09:18:31 user nova-compute[73208]:         <nova:port uuid="6ed9db81-30c0-459c-81ea-97e32f33ab56">
Aug 16 09:18:31 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 09:18:31 user nova-compute[73208]:         </nova:port>
Aug 16 09:18:31 user nova-compute[73208]:       </nova:ports>
Aug 16 09:18:31 user nova-compute[73208]:     </nova:instance>
Aug 16 09:18:31 user nova-compute[73208]:   </metadata>
Aug 16 09:18:31 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:18:31 user nova-compute[73208]:     <system>
Aug 16 09:18:31 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:18:31 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:18:31 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:18:31 user nova-compute[73208]:       <entry name="serial">b83a461d-8a5b-497b-aa52-ce2165cddb78</entry>
Aug 16 09:18:31 user nova-compute[73208]:       <entry name="uuid">b83a461d-8a5b-497b-aa52-ce2165cddb78</entry>
Aug 16 09:18:31 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:18:31 user nova-compute[73208]:     </system>
Aug 16 09:18:31 user nova-compute[73208]:   </sysinfo>
Aug 16 09:18:31 user nova-compute[73208]:   <os>
Aug 16 09:18:31 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:18:31 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:18:31 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:18:31 user nova-compute[73208]:   </os>
Aug 16 09:18:31 user nova-compute[73208]:   <features>
Aug 16 09:18:31 user nova-compute[73208]:     <acpi/>
Aug 16 09:18:31 user nova-compute[73208]:     <apic/>
Aug 16 09:18:31 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:18:31 user nova-compute[73208]:   </features>
Aug 16 09:18:31 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:18:31 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:18:31 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:18:31 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:18:31 user nova-compute[73208]:   </clock>
Aug 16 09:18:31 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:18:31 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:18:31 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:18:31 user nova-compute[73208]:   </cpu>
Aug 16 09:18:31 user nova-compute[73208]:   <devices>
Aug 16 09:18:31 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:18:31 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:18:31 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk"/>
Aug 16 09:18:31 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:18:31 user nova-compute[73208]:     </disk>
Aug 16 09:18:31 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:18:31 user nova-compute[73208]:       <mac address="fa:16:3e:1c:3d:bd"/>
Aug 16 09:18:31 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:18:31 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:18:31 user nova-compute[73208]:       <target dev="tap6ed9db81-30"/>
Aug 16 09:18:31 user nova-compute[73208]:     </interface>
Aug 16 09:18:31 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:18:31 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/console.log" append="off"/>
Aug 16 09:18:31 user nova-compute[73208]:     </serial>
Aug 16 09:18:31 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:18:31 user nova-compute[73208]:     <video>
Aug 16 09:18:31 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:18:31 user nova-compute[73208]:     </video>
Aug 16 09:18:31 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:18:31 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:18:31 user nova-compute[73208]:     </rng>
Aug 16 09:18:31 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:18:31 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:18:31 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:18:31 user nova-compute[73208]:     </memballoon>
Aug 16 09:18:31 user nova-compute[73208]:   </devices>
Aug 16 09:18:31 user nova-compute[73208]: </domain>
Aug 16 09:18:31 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1400800670',display_name='tempest-ServersNegativeTestJSON-server-1400800670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1400800670',id=26,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b71b4a11aa5d4e939c88c1e06f14abc0',ramdisk_id='',reservation_id='r-r9m9y3lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-678223637',owner_user_name='tempest-ServersNegativeTestJSON-678223637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:18:29Z,user_data=None,user_id='e67935e80e5743359098d8ef555d4f72',uuid=b83a461d-8a5b-497b-aa52-ce2165cddb78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converting VIF {"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3d:bd,bridge_name='br-int',has_traffic_filtering=True,id=6ed9db81-30c0-459c-81ea-97e32f33ab56,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed9db81-30') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG os_vif [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3d:bd,bridge_name='br-int',has_traffic_filtering=True,id=6ed9db81-30c0-459c-81ea-97e32f33ab56,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed9db81-30') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ed9db81-30, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ed9db81-30, col_values=(('external_ids', {'iface-id': '6ed9db81-30c0-459c-81ea-97e32f33ab56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:3d:bd', 'vm-uuid': 'b83a461d-8a5b-497b-aa52-ce2165cddb78'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:31 user nova-compute[73208]: INFO os_vif [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3d:bd,bridge_name='br-int',has_traffic_filtering=True,id=6ed9db81-30c0-459c-81ea-97e32f33ab56,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed9db81-30')
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] No VIF found with MAC fa:16:3e:1c:3d:bd, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177511.302254, 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] VM Resumed (Lifecycle Event)
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance spawned successfully.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177511.3094914, 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] VM Started (Lifecycle Event)
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Instance spawned successfully.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177511.3473005, 294850cd-624e-45df-b26b-18981a4ef2f2 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] VM Resumed (Lifecycle Event)
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Took 7.63 seconds to spawn the instance on the hypervisor.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Took 7.63 seconds to spawn the instance on the hypervisor.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177511.350963, 294850cd-624e-45df-b26b-18981a4ef2f2 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] VM Started (Lifecycle Event)
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.network.neutron [req-3f13be3d-168a-4c68-852f-c315b2362c6d req-c862c021-738b-42f9-89ff-342b9f3e22b9 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Updated VIF entry in instance network info cache for port 6ed9db81-30c0-459c-81ea-97e32f33ab56. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG nova.network.neutron [req-3f13be3d-168a-4c68-852f-c315b2362c6d req-c862c021-738b-42f9-89ff-342b9f3e22b9 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Updating instance_info_cache with network_info: [{"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3f13be3d-168a-4c68-852f-c315b2362c6d req-c862c021-738b-42f9-89ff-342b9f3e22b9 service nova] Releasing lock "refresh_cache-b83a461d-8a5b-497b-aa52-ce2165cddb78" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Took 8.89 seconds to build instance.
Aug 16 09:18:31 user nova-compute[73208]: INFO nova.compute.manager [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Took 19.00 seconds to build instance.
Aug 16 09:18:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71cc5d3a-af11-4f59-8d60-2638ad42a784 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.040s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5916c74b-34d2-40c7-bf5a-7f0ace4f7b06 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.111s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-ff872658-728d-4986-95fa-6ad7114cb241 req-00910128-e45f-4699-8a83-010f8a5abe78 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received event network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ff872658-728d-4986-95fa-6ad7114cb241 req-00910128-e45f-4699-8a83-010f8a5abe78 service nova] Acquiring lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ff872658-728d-4986-95fa-6ad7114cb241 req-00910128-e45f-4699-8a83-010f8a5abe78 service nova] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ff872658-728d-4986-95fa-6ad7114cb241 req-00910128-e45f-4699-8a83-010f8a5abe78 service nova] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-ff872658-728d-4986-95fa-6ad7114cb241 req-00910128-e45f-4699-8a83-010f8a5abe78 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] No waiting events found dispatching network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:18:32 user nova-compute[73208]: WARNING nova.compute.manager [req-ff872658-728d-4986-95fa-6ad7114cb241 req-00910128-e45f-4699-8a83-010f8a5abe78 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received unexpected event network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 for instance with vm_state building and task_state spawning.
Aug 16 09:18:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-b3ccf6e9-76ba-4f72-9a7d-e06d199f3516 req-6fafa964-753d-4092-a61a-7b9c7e3424a5 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received event network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b3ccf6e9-76ba-4f72-9a7d-e06d199f3516 req-6fafa964-753d-4092-a61a-7b9c7e3424a5 service nova] Acquiring lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b3ccf6e9-76ba-4f72-9a7d-e06d199f3516 req-6fafa964-753d-4092-a61a-7b9c7e3424a5 service nova] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b3ccf6e9-76ba-4f72-9a7d-e06d199f3516 req-6fafa964-753d-4092-a61a-7b9c7e3424a5 service nova] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-b3ccf6e9-76ba-4f72-9a7d-e06d199f3516 req-6fafa964-753d-4092-a61a-7b9c7e3424a5 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] No waiting events found dispatching network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:18:34 user nova-compute[73208]: WARNING nova.compute.manager [req-b3ccf6e9-76ba-4f72-9a7d-e06d199f3516 req-6fafa964-753d-4092-a61a-7b9c7e3424a5 service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received unexpected event network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 for instance with vm_state building and task_state spawning.
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177514.9231539, b83a461d-8a5b-497b-aa52-ce2165cddb78 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:18:34 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] VM Resumed (Lifecycle Event)
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:18:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Instance spawned successfully.
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:18:34 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177514.9251902, b83a461d-8a5b-497b-aa52-ce2165cddb78 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:18:34 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] VM Started (Lifecycle Event)
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:18:35 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:18:35 user nova-compute[73208]: INFO nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 16 09:18:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:18:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:35 user nova-compute[73208]: INFO nova.compute.manager [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Took 6.76 seconds to build instance.
Aug 16 09:18:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0695c30c-bbc2-4091-813d-1971917f6115 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.856s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:18:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:18:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:18:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:18:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "e136b8e0-df33-45bb-9444-191dcd24bdd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:50 user nova-compute[73208]: INFO nova.compute.manager [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Terminating instance
Aug 16 09:18:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-b0810566-07a5-4269-8ad4-b7ba30090105 req-ee35c88b-6f6a-48c0-8149-63bf43a0091f service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received event network-vif-unplugged-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0810566-07a5-4269-8ad4-b7ba30090105 req-ee35c88b-6f6a-48c0-8149-63bf43a0091f service nova] Acquiring lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0810566-07a5-4269-8ad4-b7ba30090105 req-ee35c88b-6f6a-48c0-8149-63bf43a0091f service nova] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0810566-07a5-4269-8ad4-b7ba30090105 req-ee35c88b-6f6a-48c0-8149-63bf43a0091f service nova] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-b0810566-07a5-4269-8ad4-b7ba30090105 req-ee35c88b-6f6a-48c0-8149-63bf43a0091f service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] No waiting events found dispatching network-vif-unplugged-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-b0810566-07a5-4269-8ad4-b7ba30090105 req-ee35c88b-6f6a-48c0-8149-63bf43a0091f service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received event network-vif-unplugged-c10e5d42-664f-46bf-8238-37dac3d7836b for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:18:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Instance destroyed successfully.
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.objects.instance [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lazy-loading 'resources' on Instance uuid e136b8e0-df33-45bb-9444-191dcd24bdd5 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1304488127',display_name='tempest-VolumesActionsTest-instance-1304488127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1304488127',id=21,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c480a1ba8b640bfa545bee2cf82852c',ramdisk_id='',reservation_id='r-j75460t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1567858757',owner_user_name='tempest-VolumesActionsTest-1567858757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:17:07Z,user_data=None,user_id='f1430061cf5d4c47b19ece18790df6e0',uuid=e136b8e0-df33-45bb-9444-191dcd24bdd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converting VIF {"id": "c10e5d42-664f-46bf-8238-37dac3d7836b", "address": "fa:16:3e:09:5c:0f", "network": {"id": "7ca3f808-0374-41ba-b292-bbd826d2d257", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1502649448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c480a1ba8b640bfa545bee2cf82852c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10e5d42-66", "ovs_interfaceid": "c10e5d42-664f-46bf-8238-37dac3d7836b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c10e5d42-664f-46bf-8238-37dac3d7836b,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10e5d42-66') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG os_vif [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c10e5d42-664f-46bf-8238-37dac3d7836b,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10e5d42-66') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc10e5d42-66, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:18:51 user nova-compute[73208]: INFO os_vif [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c10e5d42-664f-46bf-8238-37dac3d7836b,network=Network(7ca3f808-0374-41ba-b292-bbd826d2d257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10e5d42-66')
Aug 16 09:18:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Deleting instance files /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5_del
Aug 16 09:18:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Deletion of /opt/stack/data/nova/instances/e136b8e0-df33-45bb-9444-191dcd24bdd5_del complete
Aug 16 09:18:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:51 user nova-compute[73208]: INFO nova.compute.manager [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 16 09:18:51 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:18:51 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:18:52 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-1a196f94-9eea-4296-91f7-442eb6e1a940 req-beaf1858-b5cb-4a49-b91b-48b8ff683b13 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received event network-vif-deleted-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:52 user nova-compute[73208]: INFO nova.compute.manager [req-1a196f94-9eea-4296-91f7-442eb6e1a940 req-beaf1858-b5cb-4a49-b91b-48b8ff683b13 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Neutron deleted interface c10e5d42-664f-46bf-8238-37dac3d7836b; detaching it from the instance and deleting it from the info cache
Aug 16 09:18:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-1a196f94-9eea-4296-91f7-442eb6e1a940 req-beaf1858-b5cb-4a49-b91b-48b8ff683b13 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:18:52 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Took 1.09 seconds to deallocate network for instance.
Aug 16 09:18:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-1a196f94-9eea-4296-91f7-442eb6e1a940 req-beaf1858-b5cb-4a49-b91b-48b8ff683b13 service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Detach interface failed, port_id=c10e5d42-664f-46bf-8238-37dac3d7836b, reason: Instance e136b8e0-df33-45bb-9444-191dcd24bdd5 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:18:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:53 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:18:53 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:18:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:53 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Deleted allocations for instance e136b8e0-df33-45bb-9444-191dcd24bdd5
Aug 16 09:18:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-fec73379-1bc2-44f7-96e7-1558e0c77584 tempest-VolumesActionsTest-1567858757 tempest-VolumesActionsTest-1567858757-project-member] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.457s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-980e1081-b406-4896-844f-9ea8c201dde2 req-db1fd4c4-af51-41e4-8f29-918b28cc127c service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received event network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:18:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-980e1081-b406-4896-844f-9ea8c201dde2 req-db1fd4c4-af51-41e4-8f29-918b28cc127c service nova] Acquiring lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:18:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-980e1081-b406-4896-844f-9ea8c201dde2 req-db1fd4c4-af51-41e4-8f29-918b28cc127c service nova] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:18:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-980e1081-b406-4896-844f-9ea8c201dde2 req-db1fd4c4-af51-41e4-8f29-918b28cc127c service nova] Lock "e136b8e0-df33-45bb-9444-191dcd24bdd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:18:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-980e1081-b406-4896-844f-9ea8c201dde2 req-db1fd4c4-af51-41e4-8f29-918b28cc127c service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] No waiting events found dispatching network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:18:53 user nova-compute[73208]: WARNING nova.compute.manager [req-980e1081-b406-4896-844f-9ea8c201dde2 req-db1fd4c4-af51-41e4-8f29-918b28cc127c service nova] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Received unexpected event network-vif-plugged-c10e5d42-664f-46bf-8238-37dac3d7836b for instance with vm_state deleted and task_state None.
Aug 16 09:18:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:18:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "6b259ec1-e74b-4255-aedf-685818f23c76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:19:01 user nova-compute[73208]: INFO nova.compute.claims [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Claim successful on node user
Aug 16 09:19:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "40bcc402-c1e2-441b-ae31-400a478ea272" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "40bcc402-c1e2-441b-ae31-400a478ea272" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:01 user nova-compute[73208]: INFO nova.compute.manager [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Terminating instance
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.network.neutron [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:19:01 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:19:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:19:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:01 user nova-compute[73208]: INFO nova.virt.block_device [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Booting with blank volume at /dev/vda
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.policy [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91255b4dbf814537906275122738afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da0d7fd51c4dcaba48f74dc423e684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-44e7e7f6-3632-474c-972c-60d64d1a0705 req-90ca0e26-c7c0-4c0f-877c-c1176fe3c914 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received event network-vif-unplugged-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-44e7e7f6-3632-474c-972c-60d64d1a0705 req-90ca0e26-c7c0-4c0f-877c-c1176fe3c914 service nova] Acquiring lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-44e7e7f6-3632-474c-972c-60d64d1a0705 req-90ca0e26-c7c0-4c0f-877c-c1176fe3c914 service nova] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-44e7e7f6-3632-474c-972c-60d64d1a0705 req-90ca0e26-c7c0-4c0f-877c-c1176fe3c914 service nova] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-44e7e7f6-3632-474c-972c-60d64d1a0705 req-90ca0e26-c7c0-4c0f-877c-c1176fe3c914 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] No waiting events found dispatching network-vif-unplugged-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-44e7e7f6-3632-474c-972c-60d64d1a0705 req-90ca0e26-c7c0-4c0f-877c-c1176fe3c914 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received event network-vif-unplugged-028d4486-2056-4758-b959-08b2baeee08e for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Instance destroyed successfully.
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.objects.instance [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lazy-loading 'resources' on Instance uuid 40bcc402-c1e2-441b-ae31-400a478ea272 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-124950737',display_name='tempest-VolumesAdminNegativeTest-server-124950737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-124950737',id=22,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75b8280bca294bb6b9024f6967806d62',ramdisk_id='',reservation_id='r-hhn7aok0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-840118071',owner_user_name='tempest-VolumesAdminNegativeTest-840118071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:17:09Z,user_data=None,user_id='1f3eaa6fc3874b69be9f2859fce19859',uuid=40bcc402-c1e2-441b-ae31-400a478ea272,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converting VIF {"id": "028d4486-2056-4758-b959-08b2baeee08e", "address": "fa:16:3e:ea:49:1d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028d4486-20", "ovs_interfaceid": "028d4486-2056-4758-b959-08b2baeee08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:1d,bridge_name='br-int',has_traffic_filtering=True,id=028d4486-2056-4758-b959-08b2baeee08e,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028d4486-20') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG os_vif [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:1d,bridge_name='br-int',has_traffic_filtering=True,id=028d4486-2056-4758-b959-08b2baeee08e,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028d4486-20') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap028d4486-20, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:19:02 user nova-compute[73208]: INFO os_vif [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:1d,bridge_name='br-int',has_traffic_filtering=True,id=028d4486-2056-4758-b959-08b2baeee08e,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028d4486-20')
Aug 16 09:19:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Deleting instance files /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272_del
Aug 16 09:19:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Deletion of /opt/stack/data/nova/instances/40bcc402-c1e2-441b-ae31-400a478ea272_del complete
Aug 16 09:19:02 user nova-compute[73208]: INFO nova.compute.manager [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 16 09:19:02 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:19:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Successfully created port: 94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:19:03 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:19:03 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Took 0.93 seconds to deallocate network for instance.
Aug 16 09:19:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-aaa7ab2e-1821-461c-8289-a3bc501742f3 req-cecb79d9-b9f4-4248-ac0a-9ec457d5dfb5 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received event network-vif-deleted-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Successfully updated port: 94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:19:03 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:19:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:19:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquired lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:19:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:19:04 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Deleted allocations for instance 40bcc402-c1e2-441b-ae31-400a478ea272
Aug 16 09:19:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1c58d3d9-9bd1-4e35-abbb-395eea7ebaa9 tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "40bcc402-c1e2-441b-ae31-400a478ea272" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-858ad509-75bc-4928-acaa-150720d1474d req-2124430c-dae0-4a10-bfcc-c24c14151687 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received event network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-858ad509-75bc-4928-acaa-150720d1474d req-2124430c-dae0-4a10-bfcc-c24c14151687 service nova] Acquiring lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-858ad509-75bc-4928-acaa-150720d1474d req-2124430c-dae0-4a10-bfcc-c24c14151687 service nova] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-858ad509-75bc-4928-acaa-150720d1474d req-2124430c-dae0-4a10-bfcc-c24c14151687 service nova] Lock "40bcc402-c1e2-441b-ae31-400a478ea272-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-858ad509-75bc-4928-acaa-150720d1474d req-2124430c-dae0-4a10-bfcc-c24c14151687 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] No waiting events found dispatching network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:19:04 user nova-compute[73208]: WARNING nova.compute.manager [req-858ad509-75bc-4928-acaa-150720d1474d req-2124430c-dae0-4a10-bfcc-c24c14151687 service nova] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Received unexpected event network-vif-plugged-028d4486-2056-4758-b959-08b2baeee08e for instance with vm_state deleted and task_state None.
Aug 16 09:19:04 user nova-compute[73208]: DEBUG nova.network.neutron [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updating instance_info_cache with network_info: [{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Releasing lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:19:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance network_info: |[{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:19:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-04cfc274-986d-4729-9f7c-5d2227beb0f5 req-73b1d2cc-0c6d-4ee5-b264-a065960fcf43 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-changed-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-04cfc274-986d-4729-9f7c-5d2227beb0f5 req-73b1d2cc-0c6d-4ee5-b264-a065960fcf43 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Refreshing instance network info cache due to event network-changed-94c240e8-e39e-4f10-ba85-8d3e4126a2a4. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:19:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04cfc274-986d-4729-9f7c-5d2227beb0f5 req-73b1d2cc-0c6d-4ee5-b264-a065960fcf43 service nova] Acquiring lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:19:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04cfc274-986d-4729-9f7c-5d2227beb0f5 req-73b1d2cc-0c6d-4ee5-b264-a065960fcf43 service nova] Acquired lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:19:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-04cfc274-986d-4729-9f7c-5d2227beb0f5 req-73b1d2cc-0c6d-4ee5-b264-a065960fcf43 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Refreshing network info cache for port 94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:19:06 user nova-compute[73208]: DEBUG nova.network.neutron [req-04cfc274-986d-4729-9f7c-5d2227beb0f5 req-73b1d2cc-0c6d-4ee5-b264-a065960fcf43 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updated VIF entry in instance network info cache for port 94c240e8-e39e-4f10-ba85-8d3e4126a2a4. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:19:06 user nova-compute[73208]: DEBUG nova.network.neutron [req-04cfc274-986d-4729-9f7c-5d2227beb0f5 req-73b1d2cc-0c6d-4ee5-b264-a065960fcf43 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updating instance_info_cache with network_info: [{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:19:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04cfc274-986d-4729-9f7c-5d2227beb0f5 req-73b1d2cc-0c6d-4ee5-b264-a065960fcf43 service nova] Releasing lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:19:06 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177531.5780125, e136b8e0-df33-45bb-9444-191dcd24bdd5 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:19:06 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] VM Stopped (Lifecycle Event)
Aug 16 09:19:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2e82e339-36ea-4e89-ad2b-e4f163183d31 None None] [instance: e136b8e0-df33-45bb-9444-191dcd24bdd5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG os_brick.utils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f0eead-83f1-4742-9803-387629c777af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e015804-32a6-4bca-89b0-7bc662658008]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8195bf16-3fc8-48c9-b963-45ac8b02ed1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1c3d5c-842b-4ec7-901b-8271c6d3dc4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:19:07 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:19:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6295865a-ab54-4bd9-9eb9-5bf9b924be4a]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG os_brick.utils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:19:07 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updating existing volume attachment record: 589b43f8-f6f6-4eab-b4bd-8d562d95f0a0 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:19:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177542.4885776, 40bcc402-c1e2-441b-ae31-400a478ea272 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:19:17 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] VM Stopped (Lifecycle Event)
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d0593545-0347-4a72-94f3-2d227a81f547 None None] [instance: 40bcc402-c1e2-441b-ae31-400a478ea272] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:19:17 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Creating image(s)
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Ensure instance console log exists: /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Start _get_guest_xml network_info=[{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '589b43f8-f6f6-4eab-b4bd-8d562d95f0a0', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MewZbGpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b259ec1-e74b-4255-aedf-685818f23c76', 'attached_at': '', 'detached_at': '', 'volume_id': '5176b704-6223-44d3-9ef9-78d7458b0fa7', 'serial': '5176b704-6223-44d3-9ef9-78d7458b0fa7'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:19:17 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:19:17 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MewZbGpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:19:17 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:19:17 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:19:17 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e1d796-5564-47f9-9bd8-0744dfb932c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:19:17 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f604992-9f18-4388-8de3-7ae1ff8c6230]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7] added
Aug 16 09:19:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b3241-e3f8-4aba-a2c8-dc14aca4f928]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5008941f-ca3d-41f3-a202-86696398424a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MewZbGpF {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MewZbGpF" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60cec1d-8ab2-4843-9b47-a941ba091a44]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MewZbGpF'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d89c7aa-d7b9-4bf8-a20d-9641dda1ac7a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f53d3-bb6e-4e43-a650-3a903a51659a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[060e1b52-0752-40f8-8795-34c7b618f48c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7, portal: 172.16.0.220,3260]
Aug 16 09:19:17 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7, portal: 172.16.0.220,3260] successful.
Aug 16 09:19:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf21d70-f60f-4ea5-a141-9a7b8bb24fb2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b6799e-d0fa-419c-ba2f-c6474723d01b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:17 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:17 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:19:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[91621965-560d-4b67-adda-92a862a2f708]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:18 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MewZbGpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23161646361343837', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161646361343837', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-225187500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-225187500',id=27,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-oar6memn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:19:02Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=6b259ec1-e74b-4255-aedf-685818f23c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:98:27,bridge_name='br-int',has_traffic_filtering=True,id=94c240e8-e39e-4f10-ba85-8d3e4126a2a4,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c240e8-e3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.objects.instance [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:19:19 user nova-compute[73208]:   <uuid>6b259ec1-e74b-4255-aedf-685818f23c76</uuid>
Aug 16 09:19:19 user nova-compute[73208]:   <name>instance-0000001b</name>
Aug 16 09:19:19 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:19:19 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:19:19 user nova-compute[73208]:   <metadata>
Aug 16 09:19:19 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:19:19 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:19:19 user nova-compute[73208]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-225187500</nova:name>
Aug 16 09:19:19 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:19:17</nova:creationTime>
Aug 16 09:19:19 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:19:19 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:19:19 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:19:19 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:19:19 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:19:19 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:19:19 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:19:19 user nova-compute[73208]:       <nova:owner>
Aug 16 09:19:19 user nova-compute[73208]:         <nova:user uuid="91255b4dbf814537906275122738afcf">tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member</nova:user>
Aug 16 09:19:19 user nova-compute[73208]:         <nova:project uuid="a5da0d7fd51c4dcaba48f74dc423e684">tempest-ServerBootFromVolumeStableRescueTest-1980932529</nova:project>
Aug 16 09:19:19 user nova-compute[73208]:       </nova:owner>
Aug 16 09:19:19 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:19:19 user nova-compute[73208]:       <nova:ports>
Aug 16 09:19:19 user nova-compute[73208]:         <nova:port uuid="94c240e8-e39e-4f10-ba85-8d3e4126a2a4">
Aug 16 09:19:19 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 09:19:19 user nova-compute[73208]:         </nova:port>
Aug 16 09:19:19 user nova-compute[73208]:       </nova:ports>
Aug 16 09:19:19 user nova-compute[73208]:     </nova:instance>
Aug 16 09:19:19 user nova-compute[73208]:   </metadata>
Aug 16 09:19:19 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:19:19 user nova-compute[73208]:     <system>
Aug 16 09:19:19 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:19:19 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:19:19 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:19:19 user nova-compute[73208]:       <entry name="serial">6b259ec1-e74b-4255-aedf-685818f23c76</entry>
Aug 16 09:19:19 user nova-compute[73208]:       <entry name="uuid">6b259ec1-e74b-4255-aedf-685818f23c76</entry>
Aug 16 09:19:19 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:19:19 user nova-compute[73208]:     </system>
Aug 16 09:19:19 user nova-compute[73208]:   </sysinfo>
Aug 16 09:19:19 user nova-compute[73208]:   <os>
Aug 16 09:19:19 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:19:19 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:19:19 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:19:19 user nova-compute[73208]:   </os>
Aug 16 09:19:19 user nova-compute[73208]:   <features>
Aug 16 09:19:19 user nova-compute[73208]:     <acpi/>
Aug 16 09:19:19 user nova-compute[73208]:     <apic/>
Aug 16 09:19:19 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:19:19 user nova-compute[73208]:   </features>
Aug 16 09:19:19 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:19:19 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:19:19 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:19:19 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:19:19 user nova-compute[73208]:   </clock>
Aug 16 09:19:19 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:19:19 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:19:19 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:19:19 user nova-compute[73208]:   </cpu>
Aug 16 09:19:19 user nova-compute[73208]:   <devices>
Aug 16 09:19:19 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:19:19 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:19:19 user nova-compute[73208]:       <source dev="/dev/sdc"/>
Aug 16 09:19:19 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:19:19 user nova-compute[73208]:       <serial>5176b704-6223-44d3-9ef9-78d7458b0fa7</serial>
Aug 16 09:19:19 user nova-compute[73208]:     </disk>
Aug 16 09:19:19 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:19:19 user nova-compute[73208]:       <mac address="fa:16:3e:e6:98:27"/>
Aug 16 09:19:19 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:19:19 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:19:19 user nova-compute[73208]:       <target dev="tap94c240e8-e3"/>
Aug 16 09:19:19 user nova-compute[73208]:     </interface>
Aug 16 09:19:19 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:19:19 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/console.log" append="off"/>
Aug 16 09:19:19 user nova-compute[73208]:     </serial>
Aug 16 09:19:19 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:19:19 user nova-compute[73208]:     <video>
Aug 16 09:19:19 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:19:19 user nova-compute[73208]:     </video>
Aug 16 09:19:19 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:19:19 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:19:19 user nova-compute[73208]:     </rng>
Aug 16 09:19:19 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:19:19 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:19:19 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:19:19 user nova-compute[73208]:     </memballoon>
Aug 16 09:19:19 user nova-compute[73208]:   </devices>
Aug 16 09:19:19 user nova-compute[73208]: </domain>
Aug 16 09:19:19 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-225187500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-225187500',id=27,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-oar6memn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:19:02Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=6b259ec1-e74b-4255-aedf-685818f23c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:98:27,bridge_name='br-int',has_traffic_filtering=True,id=94c240e8-e39e-4f10-ba85-8d3e4126a2a4,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c240e8-e3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG os_vif [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:98:27,bridge_name='br-int',has_traffic_filtering=True,id=94c240e8-e39e-4f10-ba85-8d3e4126a2a4,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c240e8-e3') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c240e8-e3, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94c240e8-e3, col_values=(('external_ids', {'iface-id': '94c240e8-e39e-4f10-ba85-8d3e4126a2a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:98:27', 'vm-uuid': '6b259ec1-e74b-4255-aedf-685818f23c76'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:19 user nova-compute[73208]: INFO os_vif [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:98:27,bridge_name='br-int',has_traffic_filtering=True,id=94c240e8-e39e-4f10-ba85-8d3e4126a2a4,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c240e8-e3')
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No VIF found with MAC fa:16:3e:e6:98:27, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.compute.manager [req-56283715-ebe0-4b7c-8bee-85696f700959 req-85dd2fa1-2d7f-4481-8820-1e935bb41b9a service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received event network-changed-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.compute.manager [req-56283715-ebe0-4b7c-8bee-85696f700959 req-85dd2fa1-2d7f-4481-8820-1e935bb41b9a service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Refreshing instance network info cache due to event network-changed-86f553fb-85d6-4c04-8b94-cee199b10140. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-56283715-ebe0-4b7c-8bee-85696f700959 req-85dd2fa1-2d7f-4481-8820-1e935bb41b9a service nova] Acquiring lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-56283715-ebe0-4b7c-8bee-85696f700959 req-85dd2fa1-2d7f-4481-8820-1e935bb41b9a service nova] Acquired lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:19:19 user nova-compute[73208]: DEBUG nova.network.neutron [req-56283715-ebe0-4b7c-8bee-85696f700959 req-85dd2fa1-2d7f-4481-8820-1e935bb41b9a service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Refreshing network info cache for port 86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG nova.network.neutron [req-56283715-ebe0-4b7c-8bee-85696f700959 req-85dd2fa1-2d7f-4481-8820-1e935bb41b9a service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Updated VIF entry in instance network info cache for port 86f553fb-85d6-4c04-8b94-cee199b10140. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG nova.network.neutron [req-56283715-ebe0-4b7c-8bee-85696f700959 req-85dd2fa1-2d7f-4481-8820-1e935bb41b9a service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Updating instance_info_cache with network_info: [{"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-56283715-ebe0-4b7c-8bee-85696f700959 req-85dd2fa1-2d7f-4481-8820-1e935bb41b9a service nova] Releasing lock "refresh_cache-ae51bc16-0b87-47cd-9b37-e0a2201b4479" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:19:21 user nova-compute[73208]: WARNING nova.compute.manager [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state building and task_state spawning.
Aug 16 09:19:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:19:21 user nova-compute[73208]: WARNING nova.compute.manager [req-4b8307c2-bf3e-43fe-b4d2-f8e006c53dd0 req-01189f99-caf1-49bf-8634-f5e78c334319 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state building and task_state spawning.
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177562.6133456, 6b259ec1-e74b-4255-aedf-685818f23c76 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:19:22 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] VM Resumed (Lifecycle Event)
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:19:22 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance spawned successfully.
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:19:22 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177562.61571, 6b259ec1-e74b-4255-aedf-685818f23c76 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:19:22 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] VM Started (Lifecycle Event)
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:19:22 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:19:22 user nova-compute[73208]: INFO nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Took 5.11 seconds to spawn the instance on the hypervisor.
Aug 16 09:19:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:19:22 user nova-compute[73208]: INFO nova.compute.manager [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Took 21.55 seconds to build instance.
Aug 16 09:19:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-bac44cc9-ee59-4031-abe8-e3b1db573278 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "6b259ec1-e74b-4255-aedf-685818f23c76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.673s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:19:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:24 user nova-compute[73208]: INFO nova.compute.manager [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Attaching volume 6b4fcdec-446f-4c03-825d-c9a17a637da3 to /dev/vdb
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG os_brick.utils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e50ec-7f37-4c2c-babb-18f5244be98c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[754581e4-f202-4c51-857f-1ef9a0e681f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb9a93f-8987-4dda-94ba-edb0a0ca15b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[61be3c58-990e-4d95-a122-3a89e1df18cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:19:24 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1bfab3-7aac-42d5-8464-e3d120f440f1]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG os_brick.utils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Updating existing volume attachment record: 41f7f438-c156-4988-9a9f-c2c62125ed5c {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:19:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:27 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:19:27 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.357486724853516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8b1e6b82-35a8-44fe-ad1b-35b146491287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 294850cd-624e-45df-b26b-18981a4ef2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance b83a461d-8a5b-497b-aa52-ce2165cddb78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:19:27 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:19:28 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:19:28 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:19:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:19:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:19:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:19:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:19:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:19:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:19:30 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:19:31 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updating instance_info_cache with network_info: [{"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:19:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:19:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxGprKVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:19:34 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:19:34 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:19:34 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0add95f6-a4e4-4a8e-89c3-b3f9cc28c488]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:19:34 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa7d2ee-8556-41e4-aa7c-63898e9efe56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3] added
Aug 16 09:19:34 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e89b7f-6bca-4932-bffb-043b94d51a6e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f80063e-2047-41d5-b882-8ba1cfc60111]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxGprKVo {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxGprKVo" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe310a-c27b-43b9-9d0b-0f9914437da4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CxGprKVo'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f8dbb-ecb6-42b3-966b-aad4bc6b8585]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[72152229-43b0-4b2f-85c7-1f313894ae96]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac60b1-eb9f-4059-84fb-4e58a195dbb6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3, portal: 172.16.0.220,3260]
Aug 16 09:19:35 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3, portal: 172.16.0.220,3260] successful.
Aug 16 09:19:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f85269b-b5f6-4212-a936-fe1d42ba85fa]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[834f7d2c-ed84-4953-aea6-834610f47835]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)
Aug 16 09:19:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43aa82b-9c0f-4adf-94fc-305df801de2e]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:19:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxGprKVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26335376365653264', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335376365653264', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:19:36 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:19:36 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:19:36 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:19:36 user nova-compute[73208]:   <serial>6b4fcdec-446f-4c03-825d-c9a17a637da3</serial>
Aug 16 09:19:36 user nova-compute[73208]: </disk>
Aug 16 09:19:36 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No VIF found with MAC fa:16:3e:09:2d:24, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:19:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c03467b2-2fec-4f30-88bb-e8e33d766d87 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.031s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:37 user nova-compute[73208]: INFO nova.compute.manager [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Terminating instance
Aug 16 09:19:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-92115c19-abac-44af-8db8-6cf0a12ed70e req-bc96b1c2-4d60-4ed7-9ef9-0c851f0e8754 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-92115c19-abac-44af-8db8-6cf0a12ed70e req-bc96b1c2-4d60-4ed7-9ef9-0c851f0e8754 service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-92115c19-abac-44af-8db8-6cf0a12ed70e req-bc96b1c2-4d60-4ed7-9ef9-0c851f0e8754 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-92115c19-abac-44af-8db8-6cf0a12ed70e req-bc96b1c2-4d60-4ed7-9ef9-0c851f0e8754 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-92115c19-abac-44af-8db8-6cf0a12ed70e req-bc96b1c2-4d60-4ed7-9ef9-0c851f0e8754 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-92115c19-abac-44af-8db8-6cf0a12ed70e req-bc96b1c2-4d60-4ed7-9ef9-0c851f0e8754 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-unplugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Instance destroyed successfully.
Aug 16 09:19:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lazy-loading 'resources' on Instance uuid 8b1e6b82-35a8-44fe-ad1b-35b146491287 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-548090255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-548090255',id=16,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwJdEUl16BxJ6mhQXO60COgAMeoNKdbbkrNfM9WXFn08LFOnp0cyKzUZiknMAss58WCkPXs9/50uu1BQg/JHliga0UXhEK2dzAyXS5RlMOPiqx7aCt8h3uHTePUmCujiQ==',key_name='tempest-keypair-1890426223',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05e96874fcad4d3b8fcd66f3f513b13d',ramdisk_id='',reservation_id='r-qwm6ltdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1142897180',owner_user_name='tempest-AttachVolumeShelveTestJSON-1142897180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='858c944850cd4fe69b6c8f782cae394a',uuid=8b1e6b82-35a8-44fe-ad1b-35b146491287,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converting VIF {"id": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "address": "fa:16:3e:66:bc:32", "network": {"id": "7175babc-d772-45b6-931d-3a3e17b6a609", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1487298846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05e96874fcad4d3b8fcd66f3f513b13d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab0525e-3a", "ovs_interfaceid": "dab0525e-3a3f-459a-a384-55f5ed6886e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG os_vif [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdab0525e-3a, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:19:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:37 user nova-compute[73208]: INFO os_vif [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bc:32,bridge_name='br-int',has_traffic_filtering=True,id=dab0525e-3a3f-459a-a384-55f5ed6886e2,network=Network(7175babc-d772-45b6-931d-3a3e17b6a609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab0525e-3a')
Aug 16 09:19:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Deleting instance files /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287_del
Aug 16 09:19:38 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Deletion of /opt/stack/data/nova/instances/8b1e6b82-35a8-44fe-ad1b-35b146491287_del complete
Aug 16 09:19:38 user nova-compute[73208]: INFO nova.compute.manager [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 16 09:19:38 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:19:38 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:19:38 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:19:39 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Took 1.30 seconds to deallocate network for instance.
Aug 16 09:19:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-8178f934-efff-47c4-945d-2b144fa6ed85 req-a6e88f1a-345c-491a-9607-a9b8047e5590 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8178f934-efff-47c4-945d-2b144fa6ed85 req-a6e88f1a-345c-491a-9607-a9b8047e5590 service nova] Acquiring lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8178f934-efff-47c4-945d-2b144fa6ed85 req-a6e88f1a-345c-491a-9607-a9b8047e5590 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8178f934-efff-47c4-945d-2b144fa6ed85 req-a6e88f1a-345c-491a-9607-a9b8047e5590 service nova] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-8178f934-efff-47c4-945d-2b144fa6ed85 req-a6e88f1a-345c-491a-9607-a9b8047e5590 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] No waiting events found dispatching network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:19:39 user nova-compute[73208]: WARNING nova.compute.manager [req-8178f934-efff-47c4-945d-2b144fa6ed85 req-a6e88f1a-345c-491a-9607-a9b8047e5590 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received unexpected event network-vif-plugged-dab0525e-3a3f-459a-a384-55f5ed6886e2 for instance with vm_state deleted and task_state None.
Aug 16 09:19:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-8178f934-efff-47c4-945d-2b144fa6ed85 req-a6e88f1a-345c-491a-9607-a9b8047e5590 service nova] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Received event network-vif-deleted-dab0525e-3a3f-459a-a384-55f5ed6886e2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:39 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Deleted allocations for instance 8b1e6b82-35a8-44fe-ad1b-35b146491287
Aug 16 09:19:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d3f652c4-00f8-4e62-9083-b17c96d4b9d1 tempest-AttachVolumeShelveTestJSON-1142897180 tempest-AttachVolumeShelveTestJSON-1142897180-project-member] Lock "8b1e6b82-35a8-44fe-ad1b-35b146491287" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.577s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:41 user nova-compute[73208]: INFO nova.compute.manager [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Attaching volume dbfb94e2-edde-400a-8b07-56abe373df9b to /dev/vdc
Aug 16 09:19:41 user nova-compute[73208]: DEBUG os_brick.utils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[130c1b26-cf8a-4bcc-b376-8d7a81e1fa88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0643cc-6aa6-4e9b-9a97-cdb40d2f721e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4f657a-7472-43a7-b111-c25a54ac3fd4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b2311e-c2e2-47f2-bfa5-da06765e5e9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:19:41 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:19:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3967b63b-8f8a-40bf-ac31-3c42989f6fba]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG os_brick.utils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:19:41 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Updating existing volume attachment record: eff617af-85e0-4666-851e-17fe60cc17d0 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:19:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZmnkvyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:19:51 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:19:51 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:19:51 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[905a14e1-14be-40aa-ae32-bd33203b6563]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:19:51 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe90dbc-d92e-4461-8f24-bc5f66e9cc32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b] added
Aug 16 09:19:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[46491dee-0bed-4291-88d1-ce47fcc92318]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1857f86-33e8-43ba-bf72-fadc31bc8ca2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZmnkvyx {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZmnkvyx" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dc10d6-7ad2-4fd3-93db-e27dc0e8efdb]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XZmnkvyx'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b932a68-fd15-406c-b0e4-5422ac85ca8a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e472e863-5064-474b-94c3-206f12b979d1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fffab72-1a82-46f1-809d-5ac6b9800297]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b, portal: 172.16.0.220,3260]
Aug 16 09:19:52 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b, portal: 172.16.0.220,3260] successful.
Aug 16 09:19:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[300195a3-7602-49b3-865f-ecf90f1e99f1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90d9df6-cd5f-4482-8dc7-8e08eee18881]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)
Aug 16 09:19:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)
Aug 16 09:19:52 user nova-compute[73208]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)
Aug 16 09:19:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[026b07ac-0b00-44b8-99bc-35d432b57169]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZmnkvyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177577.9517615, 8b1e6b82-35a8-44fe-ad1b-35b146491287 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:19:52 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] VM Stopped (Lifecycle Event)
Aug 16 09:19:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e83c4686-6ba7-492d-b362-d1c27945d0a5 None None] [instance: 8b1e6b82-35a8-44fe-ad1b-35b146491287] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:19:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23038343338643337', 'path': '/dev/sde'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038343338643337', 'path': '/dev/sde'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:19:53 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:19:53 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:19:53 user nova-compute[73208]:   <target dev="vdc" bus="virtio"/>
Aug 16 09:19:53 user nova-compute[73208]:   <serial>dbfb94e2-edde-400a-8b07-56abe373df9b</serial>
Aug 16 09:19:53 user nova-compute[73208]: </disk>
Aug 16 09:19:53 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] No VIF found with MAC fa:16:3e:09:2d:24, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:19:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebc38267-1911-4e07-a5e0-25d1d7f4127f tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.452s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:54 user nova-compute[73208]: INFO nova.compute.manager [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Detaching volume 6b4fcdec-446f-4c03-825d-c9a17a637da3
Aug 16 09:19:54 user nova-compute[73208]: INFO nova.virt.block_device [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Attempting to driver detach volume 6b4fcdec-446f-4c03-825d-c9a17a637da3 from mountpoint /dev/vdb
Aug 16 09:19:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Attempting to detach device vdb from instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:19:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:19:54 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:19:54 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:19:54 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:19:54 user nova-compute[73208]:   <serial>6b4fcdec-446f-4c03-825d-c9a17a637da3</serial>
Aug 16 09:19:54 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:19:54 user nova-compute[73208]: </disk>
Aug 16 09:19:54 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:19:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully detached device vdb from instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 from the persistent domain config.
Aug 16 09:19:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:19:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:19:54 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:19:54 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:19:54 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:19:54 user nova-compute[73208]:   <serial>6b4fcdec-446f-4c03-825d-c9a17a637da3</serial>
Aug 16 09:19:54 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:19:54 user nova-compute[73208]: </disk>
Aug 16 09:19:54 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177595.1119273, ae51bc16-0b87-47cd-9b37-e0a2201b4479 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:19:55 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully detached device vdb from instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 from the live domain config.
Aug 16 09:19:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxGprKVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:19:55 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a7e18a-d516-45f8-9965-775a8512bf9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4773d1-a02d-41b4-a0a8-42170545590e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:55 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:55 user nova-compute[73208]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)
Aug 16 09:19:55 user nova-compute[73208]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)
Aug 16 09:19:55 user nova-compute[73208]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)
Aug 16 09:19:55 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:55 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:55 user nova-compute[73208]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 (non-flash)
Aug 16 09:19:55 user nova-compute[73208]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)
Aug 16 09:19:55 user nova-compute[73208]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)
Aug 16 09:19:55 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d01875b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a047a81-524b-47e8-ba62-607078bf4dfe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83b4c41-e747-4d7c-a972-5809ad4d161d]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a0a667-fdf8-49f6-9a15-3d0db109d5f1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b3df77-a0b9-4e09-8ee8-1b43c4833d03]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a1ebaa-b3b3-4356-965d-f25d84599818]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[80340465-f12b-4290-902b-7790c47bf30c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3, portal: 172.16.0.220,3260]
Aug 16 09:19:55 user nova-compute[73208]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3, portal: 172.16.0.220,3260] successful.
Aug 16 09:19:55 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4fcdec-446f-4c03-825d-c9a17a637da3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[438eced9-36ed-4509-8788-f1f0e5bbfb2c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== disconnect_volume: return (312ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:19:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:19:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d9460cb6-4411-4ca8-9ede-cd9ce6791499 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:57 user nova-compute[73208]: INFO nova.compute.manager [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Detaching volume dbfb94e2-edde-400a-8b07-56abe373df9b
Aug 16 09:19:57 user nova-compute[73208]: INFO nova.virt.block_device [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Attempting to driver detach volume dbfb94e2-edde-400a-8b07-56abe373df9b from mountpoint /dev/vdc
Aug 16 09:19:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Attempting to detach device vdc from instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:19:57 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:19:57 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:19:57 user nova-compute[73208]:   <target dev="vdc" bus="virtio"/>
Aug 16 09:19:57 user nova-compute[73208]:   <serial>dbfb94e2-edde-400a-8b07-56abe373df9b</serial>
Aug 16 09:19:57 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 09:19:57 user nova-compute[73208]: </disk>
Aug 16 09:19:57 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:19:57 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully detached device vdc from instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 from the persistent domain config.
Aug 16 09:19:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:19:57 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:19:57 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:19:57 user nova-compute[73208]:   <target dev="vdc" bus="virtio"/>
Aug 16 09:19:57 user nova-compute[73208]:   <serial>dbfb94e2-edde-400a-8b07-56abe373df9b</serial>
Aug 16 09:19:57 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 09:19:57 user nova-compute[73208]: </disk>
Aug 16 09:19:57 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177597.5274718, ae51bc16-0b87-47cd-9b37-e0a2201b4479 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:19:57 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully detached device vdc from instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 from the live domain config.
Aug 16 09:19:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZmnkvyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:19:57 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43bbf91-5e86-4470-a26a-efb73d46c6d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e2b496-18ff-4dbf-83b6-4072536fada5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:57 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:57 user nova-compute[73208]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)
Aug 16 09:19:57 user nova-compute[73208]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)
Aug 16 09:19:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:19:57 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:19:57 user nova-compute[73208]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b (non-flash)
Aug 16 09:19:57 user nova-compute[73208]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)
Aug 16 09:19:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d033e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b'): ({'sde'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Removing single pathed devices sde {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d38c7c-254c-41b6-a117-5e137d544649]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc573c8-98d0-4222-8cc8-af5ab148df40]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Flushing IO for device /dev/sde {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5396f5-b61c-4989-81bd-a0ec3944d8e1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3940ebd9-6c0c-4a85-aee1-d062745e6b40]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0bf0c-e5a7-4eaf-96a9-235b5f9cda1a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfc6d04-1ff1-4a08-b5a1-4e092d74b385]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b, portal: 172.16.0.220,3260]
Aug 16 09:19:57 user nova-compute[73208]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b, portal: 172.16.0.220,3260] successful.
Aug 16 09:19:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfb94e2-edde-400a-8b07-56abe373df9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c6242-dac9-4b2c-97b7-b910fcf60dfa]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] <== disconnect_volume: return (298ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:19:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:58 user nova-compute[73208]: DEBUG nova.objects.instance [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'flavor' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-efd7fbcb-0319-48a8-8095-d75c08e0c337 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.777s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:58 user nova-compute[73208]: INFO nova.compute.manager [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Terminating instance
Aug 16 09:19:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-abeb29f0-a873-4baf-ba33-abdd97d05da1 req-b95ff2fc-7213-498d-bdfe-9f2ff4490c9e service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received event network-vif-unplugged-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-abeb29f0-a873-4baf-ba33-abdd97d05da1 req-b95ff2fc-7213-498d-bdfe-9f2ff4490c9e service nova] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-abeb29f0-a873-4baf-ba33-abdd97d05da1 req-b95ff2fc-7213-498d-bdfe-9f2ff4490c9e service nova] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-abeb29f0-a873-4baf-ba33-abdd97d05da1 req-b95ff2fc-7213-498d-bdfe-9f2ff4490c9e service nova] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-abeb29f0-a873-4baf-ba33-abdd97d05da1 req-b95ff2fc-7213-498d-bdfe-9f2ff4490c9e service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] No waiting events found dispatching network-vif-unplugged-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-abeb29f0-a873-4baf-ba33-abdd97d05da1 req-b95ff2fc-7213-498d-bdfe-9f2ff4490c9e service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received event network-vif-unplugged-4fb59cce-601d-4b87-870f-116f52b38065 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:19:59 user nova-compute[73208]: INFO nova.compute.manager [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Terminating instance
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:19:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Instance destroyed successfully.
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lazy-loading 'resources' on Instance uuid 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1776460898',display_name='tempest-VolumesAdminNegativeTest-server-1776460898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1776460898',id=15,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLka2f5544wbEqMOL3txvsb32QBpYWll+c2FBoOodpWIsHZ1pfzCZ4YECOoUhlYrUaulr7xKpNYppI8lYdybg6PRII6mH6b9lAOZeOAEg9cQoOdMXyYZnov+Zw3gifvMYQ==',key_name='tempest-keypair-1380364193',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:11:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75b8280bca294bb6b9024f6967806d62',ramdisk_id='',reservation_id='r-njwyt0dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-840118071',owner_user_name='tempest-VolumesAdminNegativeTest-840118071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f3eaa6fc3874b69be9f2859fce19859',uuid=4421648d-a4a2-4ab2-8c13-6fbf08b0e42a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converting VIF {"id": "4fb59cce-601d-4b87-870f-116f52b38065", "address": "fa:16:3e:e1:74:3d", "network": {"id": "a176e311-13e6-4d18-966d-c54c6b1a6342", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-712060960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b8280bca294bb6b9024f6967806d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb59cce-60", "ovs_interfaceid": "4fb59cce-601d-4b87-870f-116f52b38065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:74:3d,bridge_name='br-int',has_traffic_filtering=True,id=4fb59cce-601d-4b87-870f-116f52b38065,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb59cce-60') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG os_vif [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:74:3d,bridge_name='br-int',has_traffic_filtering=True,id=4fb59cce-601d-4b87-870f-116f52b38065,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb59cce-60') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fb59cce-60, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: INFO os_vif [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:74:3d,bridge_name='br-int',has_traffic_filtering=True,id=4fb59cce-601d-4b87-870f-116f52b38065,network=Network(a176e311-13e6-4d18-966d-c54c6b1a6342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb59cce-60')
Aug 16 09:19:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Deleting instance files /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a_del
Aug 16 09:19:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Deletion of /opt/stack/data/nova/instances/4421648d-a4a2-4ab2-8c13-6fbf08b0e42a_del complete
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:19:59 user nova-compute[73208]: INFO nova.compute.manager [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 16 09:19:59 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:19:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-2a1e8234-453f-4f88-9aab-035c6af06f00 req-9469f980-cee3-4b20-b0a3-301c2ce65030 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received event network-vif-unplugged-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2a1e8234-453f-4f88-9aab-035c6af06f00 req-9469f980-cee3-4b20-b0a3-301c2ce65030 service nova] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2a1e8234-453f-4f88-9aab-035c6af06f00 req-9469f980-cee3-4b20-b0a3-301c2ce65030 service nova] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2a1e8234-453f-4f88-9aab-035c6af06f00 req-9469f980-cee3-4b20-b0a3-301c2ce65030 service nova] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-2a1e8234-453f-4f88-9aab-035c6af06f00 req-9469f980-cee3-4b20-b0a3-301c2ce65030 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] No waiting events found dispatching network-vif-unplugged-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-2a1e8234-453f-4f88-9aab-035c6af06f00 req-9469f980-cee3-4b20-b0a3-301c2ce65030 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received event network-vif-unplugged-86f553fb-85d6-4c04-8b94-cee199b10140 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:20:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Instance destroyed successfully.
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lazy-loading 'resources' on Instance uuid ae51bc16-0b87-47cd-9b37-e0a2201b4479 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1347418240',display_name='tempest-AttachVolumeTestJSON-server-1347418240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1347418240',id=23,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Jqql4F1owI7lSmZzdKeQ3rCNk/f0y3b6jT6fD7JBzIPKvYjMmQSabQgsnEQ8XCZEX+7ABVYGaAx4J4H3wZTfEnVsLtEmPsTXRyNyuo+BpT5CxTPZmLYunV3GIuBFAVA==',key_name='tempest-keypair-1164260768',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:17:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4186d2c7f14b4ab3010a7302f5f1d3',ramdisk_id='',reservation_id='r-srw4w8u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-60014534',owner_user_name='tempest-AttachVolumeTestJSON-60014534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='440128c7fc3046068e7020c70ffb25d9',uuid=ae51bc16-0b87-47cd-9b37-e0a2201b4479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converting VIF {"id": "86f553fb-85d6-4c04-8b94-cee199b10140", "address": "fa:16:3e:09:2d:24", "network": {"id": "08340d93-f625-4a45-8d23-01037fcdde86", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1973487570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4186d2c7f14b4ab3010a7302f5f1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f553fb-85", "ovs_interfaceid": "86f553fb-85d6-4c04-8b94-cee199b10140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=86f553fb-85d6-4c04-8b94-cee199b10140,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f553fb-85') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG os_vif [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=86f553fb-85d6-4c04-8b94-cee199b10140,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f553fb-85') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86f553fb-85, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:20:00 user nova-compute[73208]: INFO os_vif [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=86f553fb-85d6-4c04-8b94-cee199b10140,network=Network(08340d93-f625-4a45-8d23-01037fcdde86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f553fb-85')
Aug 16 09:20:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Deleting instance files /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479_del
Aug 16 09:20:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Deletion of /opt/stack/data/nova/instances/ae51bc16-0b87-47cd-9b37-e0a2201b4479_del complete
Aug 16 09:20:00 user nova-compute[73208]: INFO nova.compute.manager [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 09:20:00 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:20:00 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:20:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-cfeb900f-fc89-499c-80a8-e0d6794acd9f req-dd0ca097-7cdd-4fd9-a053-5ecad3334931 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received event network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cfeb900f-fc89-499c-80a8-e0d6794acd9f req-dd0ca097-7cdd-4fd9-a053-5ecad3334931 service nova] Acquiring lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cfeb900f-fc89-499c-80a8-e0d6794acd9f req-dd0ca097-7cdd-4fd9-a053-5ecad3334931 service nova] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cfeb900f-fc89-499c-80a8-e0d6794acd9f req-dd0ca097-7cdd-4fd9-a053-5ecad3334931 service nova] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-cfeb900f-fc89-499c-80a8-e0d6794acd9f req-dd0ca097-7cdd-4fd9-a053-5ecad3334931 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] No waiting events found dispatching network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:01 user nova-compute[73208]: WARNING nova.compute.manager [req-cfeb900f-fc89-499c-80a8-e0d6794acd9f req-dd0ca097-7cdd-4fd9-a053-5ecad3334931 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received unexpected event network-vif-plugged-4fb59cce-601d-4b87-870f-116f52b38065 for instance with vm_state active and task_state deleting.
Aug 16 09:20:01 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:01 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Took 1.74 seconds to deallocate network for instance.
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received event network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] Acquiring lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] No waiting events found dispatching network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:02 user nova-compute[73208]: WARNING nova.compute.manager [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received unexpected event network-vif-plugged-86f553fb-85d6-4c04-8b94-cee199b10140 for instance with vm_state active and task_state deleting.
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Received event network-vif-deleted-4fb59cce-601d-4b87-870f-116f52b38065 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Received event network-vif-deleted-86f553fb-85d6-4c04-8b94-cee199b10140 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:02 user nova-compute[73208]: INFO nova.compute.manager [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Neutron deleted interface 86f553fb-85d6-4c04-8b94-cee199b10140; detaching it from the instance and deleting it from the info cache
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.network.neutron [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:02 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Took 1.65 seconds to deallocate network for instance.
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c22e118-a34d-48a1-8624-34ee38374d9d req-40e8372c-983f-4069-a1a2-d33578906dc5 service nova] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Detach interface failed, port_id=86f553fb-85d6-4c04-8b94-cee199b10140, reason: Instance ae51bc16-0b87-47cd-9b37-e0a2201b4479 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.210s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:02 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Deleted allocations for instance 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6f895887-0dbe-412b-9f5c-85115b0f64bf tempest-VolumesAdminNegativeTest-840118071 tempest-VolumesAdminNegativeTest-840118071-project-member] Lock "4421648d-a4a2-4ab2-8c13-6fbf08b0e42a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.828s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:20:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:03 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Deleted allocations for instance ae51bc16-0b87-47cd-9b37-e0a2201b4479
Aug 16 09:20:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-360008d1-e754-4a24-8d0f-c944bff451c6 tempest-AttachVolumeTestJSON-60014534 tempest-AttachVolumeTestJSON-60014534-project-member] Lock "ae51bc16-0b87-47cd-9b37-e0a2201b4479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.414s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-bb0c58b3-7a43-48a4-8670-2425ede381fd req-4c7ccfa7-15a7-4a91-9b4e-35136a5a6f4a service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-changed-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-bb0c58b3-7a43-48a4-8670-2425ede381fd req-4c7ccfa7-15a7-4a91-9b4e-35136a5a6f4a service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Refreshing instance network info cache due to event network-changed-7a69891b-a5ef-4e60-9977-86c0cad59f1c. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:20:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bb0c58b3-7a43-48a4-8670-2425ede381fd req-4c7ccfa7-15a7-4a91-9b4e-35136a5a6f4a service nova] Acquiring lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bb0c58b3-7a43-48a4-8670-2425ede381fd req-4c7ccfa7-15a7-4a91-9b4e-35136a5a6f4a service nova] Acquired lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-bb0c58b3-7a43-48a4-8670-2425ede381fd req-4c7ccfa7-15a7-4a91-9b4e-35136a5a6f4a service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Refreshing network info cache for port 7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:20:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-bb0c58b3-7a43-48a4-8670-2425ede381fd req-4c7ccfa7-15a7-4a91-9b4e-35136a5a6f4a service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updated VIF entry in instance network info cache for port 7a69891b-a5ef-4e60-9977-86c0cad59f1c. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:20:05 user nova-compute[73208]: DEBUG nova.network.neutron [req-bb0c58b3-7a43-48a4-8670-2425ede381fd req-4c7ccfa7-15a7-4a91-9b4e-35136a5a6f4a service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bb0c58b3-7a43-48a4-8670-2425ede381fd req-4c7ccfa7-15a7-4a91-9b4e-35136a5a6f4a service nova] Releasing lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Stashing vm_state: active {{(pid=73208) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 09:20:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-ededdf8d-35eb-43f8-aeae-e73d9fe94cb5 req-e5eeb231-a2d0-4006-b523-21287c66bd3a service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-changed-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-ededdf8d-35eb-43f8-aeae-e73d9fe94cb5 req-e5eeb231-a2d0-4006-b523-21287c66bd3a service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Refreshing instance network info cache due to event network-changed-1bc92838-8385-428d-a6cb-ddecf30e8c2b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:20:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ededdf8d-35eb-43f8-aeae-e73d9fe94cb5 req-e5eeb231-a2d0-4006-b523-21287c66bd3a service nova] Acquiring lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ededdf8d-35eb-43f8-aeae-e73d9fe94cb5 req-e5eeb231-a2d0-4006-b523-21287c66bd3a service nova] Acquired lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:06 user nova-compute[73208]: DEBUG nova.network.neutron [req-ededdf8d-35eb-43f8-aeae-e73d9fe94cb5 req-e5eeb231-a2d0-4006-b523-21287c66bd3a service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Refreshing network info cache for port 1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:20:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:07 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'pci_requests' on Instance uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:20:07 user nova-compute[73208]: INFO nova.compute.claims [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Claim successful on node user
Aug 16 09:20:07 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'resources' on Instance uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-ededdf8d-35eb-43f8-aeae-e73d9fe94cb5 req-e5eeb231-a2d0-4006-b523-21287c66bd3a service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updated VIF entry in instance network info cache for port 1bc92838-8385-428d-a6cb-ddecf30e8c2b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:20:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-ededdf8d-35eb-43f8-aeae-e73d9fe94cb5 req-e5eeb231-a2d0-4006-b523-21287c66bd3a service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating instance_info_cache with network_info: [{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:07 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'pci_devices' on Instance uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ededdf8d-35eb-43f8-aeae-e73d9fe94cb5 req-e5eeb231-a2d0-4006-b523-21287c66bd3a service nova] Releasing lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:07 user nova-compute[73208]: INFO nova.compute.resource_tracker [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating resource usage from migration 92cbc669-881b-4078-8424-dbdbb0c280eb
Aug 16 09:20:07 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:20:07 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:20:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.408s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:08 user nova-compute[73208]: INFO nova.compute.manager [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Migrating
Aug 16 09:20:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquired lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:08 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:20:09 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating instance_info_cache with network_info: [{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Releasing lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Starting migrate_disk_and_power_off {{(pid=73208) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 09:20:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:20:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-702a8ba0-e0ab-4753-950b-1080fe243c28 req-bd219d72-80be-45ec-b9e4-6e3cb4f53240 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-unplugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-702a8ba0-e0ab-4753-950b-1080fe243c28 req-bd219d72-80be-45ec-b9e4-6e3cb4f53240 service nova] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-702a8ba0-e0ab-4753-950b-1080fe243c28 req-bd219d72-80be-45ec-b9e4-6e3cb4f53240 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-702a8ba0-e0ab-4753-950b-1080fe243c28 req-bd219d72-80be-45ec-b9e4-6e3cb4f53240 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-702a8ba0-e0ab-4753-950b-1080fe243c28 req-bd219d72-80be-45ec-b9e4-6e3cb4f53240 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] No waiting events found dispatching network-vif-unplugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:11 user nova-compute[73208]: WARNING nova.compute.manager [req-702a8ba0-e0ab-4753-950b-1080fe243c28 req-bd219d72-80be-45ec-b9e4-6e3cb4f53240 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received unexpected event network-vif-unplugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b for instance with vm_state active and task_state resize_migrating.
Aug 16 09:20:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:11 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance destroyed successfully.
Aug 16 09:20:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1569928669',display_name='tempest-ServerActionsTestOtherA-server-1569928669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1569928669',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:18:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-sfnlvq70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=00e2e59e-60e2-4833-8ca1-26a41dad5ea1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1725340969-network", "vif_mac": "fa:16:3e:fb:90:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1725340969-network", "vif_mac": "fa:16:3e:fb:90:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_vif [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bc92838-83, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:11 user nova-compute[73208]: INFO os_vif [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83')
Aug 16 09:20:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tESfwzTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:20:11 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b04939-580d-4e63-8c67-7f4cef0d57b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d15879e-17bf-4f70-b575-9b6d802d3f3b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:11 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:11 user nova-compute[73208]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)
Aug 16 09:20:11 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:11 user nova-compute[73208]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:11 user nova-compute[73208]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e930bd-4cdf-43d5-a7d0-68819f0f7944 (non-flash)
Aug 16 09:20:11 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f0117f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfeb00d-8f23-46c8-81c0-b70624ce28a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f8e232-f05c-44f8-b94b-3821d3f52de1]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d6fb27-4a35-4be0-8e1c-eb607a2b0104]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:20:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a27a080-601c-455b-a6b9-62dee5ff0ca5]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf5776c93-7f4139987f1d3c9a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f5776c93', '/dev/disk/by-id/scsi-23766343133393938') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:20:12 user nova-compute[73208]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf5776c93-7f4139987f1d3c9a
Aug 16 09:20:12 user nova-compute[73208]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f5776c93
Aug 16 09:20:12 user nova-compute[73208]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23766343133393938
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6edd1ba-7a10-4a29-8194-4ded54dd9c31]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef722f-6c54-4a3a-a6a7-c7e2552b5fcf]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7a7105-c950-4c65-8029-aa9333b96404]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260]
Aug 16 09:20:12 user nova-compute[73208]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260] successful.
Aug 16 09:20:12 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b90a8-6520-4ba2-aab0-5020193f3dbd]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== disconnect_volume: return (397ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:20:12 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:20:13 user nova-compute[73208]: DEBUG nova.compute.manager [req-0d7e76e3-418d-45e7-a0c9-6df52ec7053f req-da4004c1-5f50-4f4a-8f1e-e5c8196aa67e service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0d7e76e3-418d-45e7-a0c9-6df52ec7053f req-da4004c1-5f50-4f4a-8f1e-e5c8196aa67e service nova] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0d7e76e3-418d-45e7-a0c9-6df52ec7053f req-da4004c1-5f50-4f4a-8f1e-e5c8196aa67e service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0d7e76e3-418d-45e7-a0c9-6df52ec7053f req-da4004c1-5f50-4f4a-8f1e-e5c8196aa67e service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:13 user nova-compute[73208]: DEBUG nova.compute.manager [req-0d7e76e3-418d-45e7-a0c9-6df52ec7053f req-da4004c1-5f50-4f4a-8f1e-e5c8196aa67e service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] No waiting events found dispatching network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:13 user nova-compute[73208]: WARNING nova.compute.manager [req-0d7e76e3-418d-45e7-a0c9-6df52ec7053f req-da4004c1-5f50-4f4a-8f1e-e5c8196aa67e service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received unexpected event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b for instance with vm_state active and task_state resize_migrating.
Aug 16 09:20:13 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Port 1bc92838-8385-428d-a6cb-ddecf30e8c2b binding to destination host user is already ACTIVE {{(pid=73208) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 09:20:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquired lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:14 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:20:14 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177599.7772026, 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:20:14 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] VM Stopped (Lifecycle Event)
Aug 16 09:20:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8e0f6a02-d639-48d6-8756-fe0334bd0daf None None] [instance: 4421648d-a4a2-4ab2-8c13-6fbf08b0e42a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating instance_info_cache with network_info: [{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Releasing lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG os_brick.utils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c1bfad-b664-4444-ae59-a1be083ff913]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8ed24c-a9f3-4d85-ac8c-90f2bb215e08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f284c90-78fc-4064-b2bc-5ef33fc2efdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d34220c-09eb-4140-a23d-5b60d0a0defe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:20:15 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130b4c2-8935-43bf-8adf-7de6147f94dd]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG os_brick.utils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177600.5369985, ae51bc16-0b87-47cd-9b37-e0a2201b4479 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:20:15 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] VM Stopped (Lifecycle Event)
Aug 16 09:20:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8878b871-e620-41bf-93dc-5b64382d10e0 None None] [instance: ae51bc16-0b87-47cd-9b37-e0a2201b4479] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-f5867f48-f6ca-42d7-8e70-b2ac97737ca2 req-4c388555-2a90-4325-ac97-6a470f4cd03f service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-changed-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-f5867f48-f6ca-42d7-8e70-b2ac97737ca2 req-4c388555-2a90-4325-ac97-6a470f4cd03f service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Refreshing instance network info cache due to event network-changed-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5867f48-f6ca-42d7-8e70-b2ac97737ca2 req-4c388555-2a90-4325-ac97-6a470f4cd03f service nova] Acquiring lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5867f48-f6ca-42d7-8e70-b2ac97737ca2 req-4c388555-2a90-4325-ac97-6a470f4cd03f service nova] Acquired lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:15 user nova-compute[73208]: DEBUG nova.network.neutron [req-f5867f48-f6ca-42d7-8e70-b2ac97737ca2 req-4c388555-2a90-4325-ac97-6a470f4cd03f service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Refreshing network info cache for port d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'flavor' on Instance uuid 294850cd-624e-45df-b26b-18981a4ef2f2 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-f5867f48-f6ca-42d7-8e70-b2ac97737ca2 req-4c388555-2a90-4325-ac97-6a470f4cd03f service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updated VIF entry in instance network info cache for port d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-f5867f48-f6ca-42d7-8e70-b2ac97737ca2 req-4c388555-2a90-4325-ac97-6a470f4cd03f service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updating instance_info_cache with network_info: [{"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5867f48-f6ca-42d7-8e70-b2ac97737ca2 req-4c388555-2a90-4325-ac97-6a470f4cd03f service nova] Releasing lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.189s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:16 user nova-compute[73208]: INFO nova.compute.manager [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Attaching volume 0f0d346d-0793-4c06-9bce-5a94457254d3 to /dev/vdb
Aug 16 09:20:16 user nova-compute[73208]: DEBUG os_brick.utils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59b3565-55d8-4746-ad8a-c52a29a3db8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[20618508-42fb-42b5-913d-8f45109ed95f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd74120-08eb-46d0-a641-df09bb4365b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8c82be-e1c5-4cd6-9de4-efeb5a04ce3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:20:16 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:20:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb89d0fd-1a88-467b-99b4-37ae1f90b348]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG os_brick.utils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updating existing volume attachment record: 394175c6-a79e-43f3-ad70-56d73b35c7b1 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:20:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "b83a461d-8a5b-497b-aa52-ce2165cddb78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:18 user nova-compute[73208]: INFO nova.compute.manager [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Terminating instance
Aug 16 09:20:18 user nova-compute[73208]: DEBUG nova.compute.manager [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-716354e6-bf23-424a-86f9-4eab29692136 req-7808888e-78a3-4217-92ab-4c0a18742a0d service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received event network-vif-unplugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-716354e6-bf23-424a-86f9-4eab29692136 req-7808888e-78a3-4217-92ab-4c0a18742a0d service nova] Acquiring lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-716354e6-bf23-424a-86f9-4eab29692136 req-7808888e-78a3-4217-92ab-4c0a18742a0d service nova] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-716354e6-bf23-424a-86f9-4eab29692136 req-7808888e-78a3-4217-92ab-4c0a18742a0d service nova] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-716354e6-bf23-424a-86f9-4eab29692136 req-7808888e-78a3-4217-92ab-4c0a18742a0d service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] No waiting events found dispatching network-vif-unplugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-716354e6-bf23-424a-86f9-4eab29692136 req-7808888e-78a3-4217-92ab-4c0a18742a0d service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received event network-vif-unplugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Instance destroyed successfully.
Aug 16 09:20:19 user nova-compute[73208]: DEBUG nova.objects.instance [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lazy-loading 'resources' on Instance uuid b83a461d-8a5b-497b-aa52-ce2165cddb78 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1400800670',display_name='tempest-ServersNegativeTestJSON-server-1400800670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1400800670',id=26,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b71b4a11aa5d4e939c88c1e06f14abc0',ramdisk_id='',reservation_id='r-r9m9y3lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-678223637',owner_user_name='tempest-ServersNegativeTestJSON-678223637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:18:35Z,user_data=None,user_id='e67935e80e5743359098d8ef555d4f72',uuid=b83a461d-8a5b-497b-aa52-ce2165cddb78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converting VIF {"id": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "address": "fa:16:3e:1c:3d:bd", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed9db81-30", "ovs_interfaceid": "6ed9db81-30c0-459c-81ea-97e32f33ab56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3d:bd,bridge_name='br-int',has_traffic_filtering=True,id=6ed9db81-30c0-459c-81ea-97e32f33ab56,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed9db81-30') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG os_vif [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3d:bd,bridge_name='br-int',has_traffic_filtering=True,id=6ed9db81-30c0-459c-81ea-97e32f33ab56,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed9db81-30') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ed9db81-30, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:19 user nova-compute[73208]: INFO os_vif [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3d:bd,bridge_name='br-int',has_traffic_filtering=True,id=6ed9db81-30c0-459c-81ea-97e32f33ab56,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed9db81-30')
Aug 16 09:20:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Deleting instance files /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78_del
Aug 16 09:20:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Deletion of /opt/stack/data/nova/instances/b83a461d-8a5b-497b-aa52-ce2165cddb78_del complete
Aug 16 09:20:19 user nova-compute[73208]: INFO nova.compute.manager [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 16 09:20:19 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:19 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Took 0.56 seconds to deallocate network for instance.
Aug 16 09:20:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:20 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Deleted allocations for instance b83a461d-8a5b-497b-aa52-ce2165cddb78
Aug 16 09:20:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-78389bc2-dc0b-42b5-a524-093c47dbb224 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.836s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-75036ec8-d4b6-4dd5-b192-33d6869b9031 req-274d1c3f-3686-4e93-9df9-0fad02f5399c service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received event network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-75036ec8-d4b6-4dd5-b192-33d6869b9031 req-274d1c3f-3686-4e93-9df9-0fad02f5399c service nova] Acquiring lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-75036ec8-d4b6-4dd5-b192-33d6869b9031 req-274d1c3f-3686-4e93-9df9-0fad02f5399c service nova] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-75036ec8-d4b6-4dd5-b192-33d6869b9031 req-274d1c3f-3686-4e93-9df9-0fad02f5399c service nova] Lock "b83a461d-8a5b-497b-aa52-ce2165cddb78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-75036ec8-d4b6-4dd5-b192-33d6869b9031 req-274d1c3f-3686-4e93-9df9-0fad02f5399c service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] No waiting events found dispatching network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:20 user nova-compute[73208]: WARNING nova.compute.manager [req-75036ec8-d4b6-4dd5-b192-33d6869b9031 req-274d1c3f-3686-4e93-9df9-0fad02f5399c service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received unexpected event network-vif-plugged-6ed9db81-30c0-459c-81ea-97e32f33ab56 for instance with vm_state deleted and task_state None.
Aug 16 09:20:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-75036ec8-d4b6-4dd5-b192-33d6869b9031 req-274d1c3f-3686-4e93-9df9-0fad02f5399c service nova] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Received event network-vif-deleted-6ed9db81-30c0-459c-81ea-97e32f33ab56 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:23 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:20:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:20:26 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8078MB free_disk=25.465782165527344GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Starting finish_migration {{(pid=73208) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance directory exists: not creating {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 09:20:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Creating image(s)
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Ensure instance console log exists: /opt/stack/data/nova/instances/00e2e59e-60e2-4833-8ca1-26a41dad5ea1/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Start _get_guest_xml network_info=[{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1725340969-network", "vif_mac": "fa:16:3e:fb:90:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '8f9dd756-e3c6-4392-81c3-9a2378c75770', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tESfwzTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '00e2e59e-60e2-4833-8ca1-26a41dad5ea1', 'attached_at': '2023-08-16T09:20:26.000000', 'detached_at': '', 'volume_id': '81c53afb-aecc-422f-a2cb-332d0dbf6cb6', 'serial': '81c53afb-aecc-422f-a2cb-332d0dbf6cb6'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Applying migration context for instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 as it has an incoming, in-progress migration 92cbc669-881b-4078-8424-dbdbb0c280eb. Migration status is post-migrating {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 09:20:26 user nova-compute[73208]: INFO nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating resource usage from migration 92cbc669-881b-4078-8424-dbdbb0c280eb
Aug 16 09:20:26 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:20:26 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 294850cd-624e-45df-b26b-18981a4ef2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Migration 92cbc669-881b-4078-8424-dbdbb0c280eb is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tESfwzTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:20:26 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:20:26 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:20:26 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9095cbe1-c023-4ace-a0ad-8f4a77b4268d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:20:26 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca161e69-a042-4113-86bd-a88adf78ceb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6] added
Aug 16 09:20:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3d8748-c282-44d0-aefc-c8f76d47b35d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c657e394-3d0f-4062-87b4-105c653aa4a4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tESfwzTP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tESfwzTP" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f04bf2-e0ad-4ed8-b926-bbd781f52324]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tESfwzTP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47f138b-43e5-4f58-b048-a4adda43905d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[519328a7-a0d5-4182-9cfb-f966527cb8ca]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177611.7432034, 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:20:26 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] VM Stopped (Lifecycle Event)
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-47206038-31fb-4a18-b1ef-00347725bfe5 None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-47206038-31fb-4a18-b1ef-00347725bfe5 None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:20:26 user nova-compute[73208]: INFO nova.compute.manager [None req-47206038-31fb-4a18-b1ef-00347725bfe5 None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7feb70-64bd-4084-b157-f6e634477afc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260]
Aug 16 09:20:26 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260] successful.
Aug 16 09:20:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac243241-1e6f-4a7f-9422-196afcb62a23]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554c54c-aa75-4ced-a83f-eb4cb5ad3b97]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:26 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:26 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cbbb87-7643-48b0-8378-6f1d136b79aa]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:20:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tESfwzTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvlWNgqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:20:27 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23766343133393938', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766343133393938', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.278s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:20:27 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:20:27 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70ebe9e-4063-473a-998f-97864b467477]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:20:27 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1569928669',display_name='tempest-ServerActionsTestOtherA-server-1569928669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1569928669',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:18:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-sfnlvq70',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:20:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=00e2e59e-60e2-4833-8ca1-26a41dad5ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1725340969-network", "vif_mac": "fa:16:3e:fb:90:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1725340969-network", "vif_mac": "fa:16:3e:fb:90:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:20:27 user nova-compute[73208]:   <uuid>00e2e59e-60e2-4833-8ca1-26a41dad5ea1</uuid>
Aug 16 09:20:27 user nova-compute[73208]:   <name>instance-00000018</name>
Aug 16 09:20:27 user nova-compute[73208]:   <memory>2097152</memory>
Aug 16 09:20:27 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:20:27 user nova-compute[73208]:   <metadata>
Aug 16 09:20:27 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:20:27 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:20:27 user nova-compute[73208]:       <nova:name>tempest-ServerActionsTestOtherA-server-1569928669</nova:name>
Aug 16 09:20:27 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:20:26</nova:creationTime>
Aug 16 09:20:27 user nova-compute[73208]:       <nova:flavor name="m1.small">
Aug 16 09:20:27 user nova-compute[73208]:         <nova:memory>2048</nova:memory>
Aug 16 09:20:27 user nova-compute[73208]:         <nova:disk>20</nova:disk>
Aug 16 09:20:27 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:20:27 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:20:27 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:20:27 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:20:27 user nova-compute[73208]:       <nova:owner>
Aug 16 09:20:27 user nova-compute[73208]:         <nova:user uuid="e351e35970aa48028ad400bbda5403b1">tempest-ServerActionsTestOtherA-1386845270-project-member</nova:user>
Aug 16 09:20:27 user nova-compute[73208]:         <nova:project uuid="d62017e5fe324a528f4ad1dc5c939498">tempest-ServerActionsTestOtherA-1386845270</nova:project>
Aug 16 09:20:27 user nova-compute[73208]:       </nova:owner>
Aug 16 09:20:27 user nova-compute[73208]:       <nova:ports>
Aug 16 09:20:27 user nova-compute[73208]:         <nova:port uuid="1bc92838-8385-428d-a6cb-ddecf30e8c2b">
Aug 16 09:20:27 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 09:20:27 user nova-compute[73208]:         </nova:port>
Aug 16 09:20:27 user nova-compute[73208]:       </nova:ports>
Aug 16 09:20:27 user nova-compute[73208]:     </nova:instance>
Aug 16 09:20:27 user nova-compute[73208]:   </metadata>
Aug 16 09:20:27 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:20:27 user nova-compute[73208]:     <system>
Aug 16 09:20:27 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:20:27 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:20:27 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:20:27 user nova-compute[73208]:       <entry name="serial">00e2e59e-60e2-4833-8ca1-26a41dad5ea1</entry>
Aug 16 09:20:27 user nova-compute[73208]:       <entry name="uuid">00e2e59e-60e2-4833-8ca1-26a41dad5ea1</entry>
Aug 16 09:20:27 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:20:27 user nova-compute[73208]:     </system>
Aug 16 09:20:27 user nova-compute[73208]:   </sysinfo>
Aug 16 09:20:27 user nova-compute[73208]:   <os>
Aug 16 09:20:27 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:20:27 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:20:27 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:20:27 user nova-compute[73208]:   </os>
Aug 16 09:20:27 user nova-compute[73208]:   <features>
Aug 16 09:20:27 user nova-compute[73208]:     <acpi/>
Aug 16 09:20:27 user nova-compute[73208]:     <apic/>
Aug 16 09:20:27 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:20:27 user nova-compute[73208]:   </features>
Aug 16 09:20:27 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:20:27 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:20:27 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:20:27 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:20:27 user nova-compute[73208]:   </clock>
Aug 16 09:20:27 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:20:27 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:20:27 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:20:27 user nova-compute[73208]:   </cpu>
Aug 16 09:20:27 user nova-compute[73208]:   <devices>
Aug 16 09:20:27 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:20:27 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:20:27 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:20:27 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:20:27 user nova-compute[73208]:       <serial>81c53afb-aecc-422f-a2cb-332d0dbf6cb6</serial>
Aug 16 09:20:27 user nova-compute[73208]:     </disk>
Aug 16 09:20:27 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:20:27 user nova-compute[73208]:       <mac address="fa:16:3e:fb:90:2c"/>
Aug 16 09:20:27 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:20:27 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:20:27 user nova-compute[73208]:       <target dev="tap1bc92838-83"/>
Aug 16 09:20:27 user nova-compute[73208]:     </interface>
Aug 16 09:20:27 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:20:27 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/00e2e59e-60e2-4833-8ca1-26a41dad5ea1/console.log" append="off"/>
Aug 16 09:20:27 user nova-compute[73208]:     </serial>
Aug 16 09:20:27 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:20:27 user nova-compute[73208]:     <video>
Aug 16 09:20:27 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:20:27 user nova-compute[73208]:     </video>
Aug 16 09:20:27 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:20:27 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:20:27 user nova-compute[73208]:     </rng>
Aug 16 09:20:27 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:20:27 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:20:27 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:20:27 user nova-compute[73208]:     </memballoon>
Aug 16 09:20:27 user nova-compute[73208]:   </devices>
Aug 16 09:20:27 user nova-compute[73208]: </domain>
Aug 16 09:20:27 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1569928669',display_name='tempest-ServerActionsTestOtherA-server-1569928669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1569928669',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:18:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-sfnlvq70',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:20:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=00e2e59e-60e2-4833-8ca1-26a41dad5ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1725340969-network", "vif_mac": "fa:16:3e:fb:90:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1725340969-network", "vif_mac": "fa:16:3e:fb:90:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_vif [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab04789-c44f-437c-9a9a-c3898bf0be21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3] added
Aug 16 09:20:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bc92838-83, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1bc92838-83, col_values=(('external_ids', {'iface-id': '1bc92838-8385-428d-a6cb-ddecf30e8c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:90:2c', 'vm-uuid': '00e2e59e-60e2-4833-8ca1-26a41dad5ea1'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:27 user nova-compute[73208]: INFO os_vif [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83')
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fd0cea-b574-4193-85b1-b096fb409d1e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa32a9e-48cd-4c3c-aacb-e25f438ccc40]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvlWNgqT {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvlWNgqT" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[abce29d5-164c-441a-9edc-38a344212889]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EvlWNgqT'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] No VIF found with MAC fa:16:3e:fb:90:2c, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a701a139-5ffd-47bb-be26-00254b1bddff]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3283c-bdac-47fd-9cb5-c6aea649a07b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eeded4-8015-4a45-88b5-a3537d980a58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3, portal: 172.16.0.220,3260]
Aug 16 09:20:28 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3, portal: 172.16.0.220,3260] successful.
Aug 16 09:20:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48ae717-deec-4f88-8231-f4c8a213e676]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9db58e-f8b6-42c5-8d12-d6c6ac188025]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 (non-flash)
Aug 16 09:20:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[085f88b3-2f34-45a2-9557-c91beed2281f]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvlWNgqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:20:28 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] <== connect_volume: return (1609ms) {'type': 'block', 'scsi_wwn': '26339376161656562', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339376161656562', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'flavor' on Instance uuid 294850cd-624e-45df-b26b-18981a4ef2f2 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:20:29 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:20:29 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:20:29 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:20:29 user nova-compute[73208]:   <serial>0f0d346d-0793-4c06-9bce-5a94457254d3</serial>
Aug 16 09:20:29 user nova-compute[73208]: </disk>
Aug 16 09:20:29 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG nova.compute.manager [req-23df536f-440e-445b-a55d-1a29035df484 req-ea4d4d53-6463-4ce2-94b4-b9f0a84a3c8b service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-23df536f-440e-445b-a55d-1a29035df484 req-ea4d4d53-6463-4ce2-94b4-b9f0a84a3c8b service nova] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-23df536f-440e-445b-a55d-1a29035df484 req-ea4d4d53-6463-4ce2-94b4-b9f0a84a3c8b service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-23df536f-440e-445b-a55d-1a29035df484 req-ea4d4d53-6463-4ce2-94b4-b9f0a84a3c8b service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG nova.compute.manager [req-23df536f-440e-445b-a55d-1a29035df484 req-ea4d4d53-6463-4ce2-94b4-b9f0a84a3c8b service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] No waiting events found dispatching network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:29 user nova-compute[73208]: WARNING nova.compute.manager [req-23df536f-440e-445b-a55d-1a29035df484 req-ea4d4d53-6463-4ce2-94b4-b9f0a84a3c8b service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received unexpected event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b for instance with vm_state active and task_state resize_finish.
Aug 16 09:20:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] No VIF found with MAC fa:16:3e:90:4e:9f, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:20:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f2f6ac3-f78f-43c6-af5a-94f72fde58ab tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.412s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.compute.manager [req-8708708f-7f85-4421-b814-861f3a50a9d6 req-0fa4c3b5-f837-4081-af11-a09a1aaaa349 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8708708f-7f85-4421-b814-861f3a50a9d6 req-0fa4c3b5-f837-4081-af11-a09a1aaaa349 service nova] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8708708f-7f85-4421-b814-861f3a50a9d6 req-0fa4c3b5-f837-4081-af11-a09a1aaaa349 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8708708f-7f85-4421-b814-861f3a50a9d6 req-0fa4c3b5-f837-4081-af11-a09a1aaaa349 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.compute.manager [req-8708708f-7f85-4421-b814-861f3a50a9d6 req-0fa4c3b5-f837-4081-af11-a09a1aaaa349 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] No waiting events found dispatching network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:31 user nova-compute[73208]: WARNING nova.compute.manager [req-8708708f-7f85-4421-b814-861f3a50a9d6 req-0fa4c3b5-f837-4081-af11-a09a1aaaa349 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received unexpected event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b for instance with vm_state active and task_state resize_finish.
Aug 16 09:20:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177631.8043466, 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:20:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] VM Resumed (Lifecycle Event)
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:20:31 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance running successfully.
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Failed to set time: agent not configured {{(pid=73208) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d190b388-eda0-40fa-bd29-df15417622ef tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] finish_migration finished successfully. {{(pid=73208) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:20:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177631.8100274, 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:20:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] VM Started (Lifecycle Event)
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:20:31 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 09:20:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:32 user nova-compute[73208]: INFO nova.compute.manager [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Detaching volume 0f0d346d-0793-4c06-9bce-5a94457254d3
Aug 16 09:20:32 user nova-compute[73208]: INFO nova.virt.block_device [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Attempting to driver detach volume 0f0d346d-0793-4c06-9bce-5a94457254d3 from mountpoint /dev/vdb
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Attempting to detach device vdb from instance 294850cd-624e-45df-b26b-18981a4ef2f2 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:20:32 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:20:32 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:20:32 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:20:32 user nova-compute[73208]:   <serial>0f0d346d-0793-4c06-9bce-5a94457254d3</serial>
Aug 16 09:20:32 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:20:32 user nova-compute[73208]: </disk>
Aug 16 09:20:32 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:20:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Successfully detached device vdb from instance 294850cd-624e-45df-b26b-18981a4ef2f2 from the persistent domain config.
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 294850cd-624e-45df-b26b-18981a4ef2f2 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:20:32 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:20:32 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:20:32 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:20:32 user nova-compute[73208]:   <serial>0f0d346d-0793-4c06-9bce-5a94457254d3</serial>
Aug 16 09:20:32 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:20:32 user nova-compute[73208]: </disk>
Aug 16 09:20:32 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updating instance_info_cache with network_info: [{"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177632.6851535, 294850cd-624e-45df-b26b-18981a4ef2f2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 294850cd-624e-45df-b26b-18981a4ef2f2 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:20:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Successfully detached device vdb from instance 294850cd-624e-45df-b26b-18981a4ef2f2 from the live domain config.
Aug 16 09:20:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvlWNgqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:20:32 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffe308-fc48-4654-952d-e4034328114a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f8f66-7755-4d9d-96ea-66efb81c6090]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:32 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:32 user nova-compute[73208]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 (non-flash)
Aug 16 09:20:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:32 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:32 user nova-compute[73208]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 (non-flash)
Aug 16 09:20:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d03ce170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5041b99b-c860-4f5f-b83c-37534a016553]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[37363296-1130-4262-b588-0e671924ef24]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f10337-0c7f-4d52-a337-51614897a7f9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[66caf001-5b71-424f-9d38-a655c604c4ac]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[69653aeb-8c92-47fe-9f15-43b3c62203fe]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3774ea9b-bbc8-4d43-a391-1b1f4dbf40d8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3, portal: 172.16.0.220,3260]
Aug 16 09:20:33 user nova-compute[73208]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3, portal: 172.16.0.220,3260] successful.
Aug 16 09:20:33 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0d346d-0793-4c06-9bce-5a94457254d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ced591-35e3-461c-b805-e81457dee4cf]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] <== disconnect_volume: return (338ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'flavor' on Instance uuid 294850cd-624e-45df-b26b-18981a4ef2f2 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7a49b6db-d370-4ad0-87f2-3a667fadabef tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.914s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:34 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177619.237231, b83a461d-8a5b-497b-aa52-ce2165cddb78 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:20:34 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] VM Stopped (Lifecycle Event)
Aug 16 09:20:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cda3d0dd-6920-429a-87c1-9bce6f1061bf None None] [instance: b83a461d-8a5b-497b-aa52-ce2165cddb78] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:20:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:20:49 user nova-compute[73208]: INFO nova.compute.claims [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Claim successful on node user
Aug 16 09:20:49 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:20:49 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:20:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:20:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG nova.policy [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5e7700a95794faca71c1781b2991241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75db810c942649859c59c7e7eb85b96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:20:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Creating image(s)
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "/opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "/opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.213s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk 1073741824" returned: 0 in 0.067s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.202s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:20:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Cannot resize image /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'migration_context' on Instance uuid 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Ensure instance console log exists: /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Successfully created port: d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:20:52 user nova-compute[73208]: INFO nova.compute.manager [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Rescuing
Aug 16 09:20:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquired lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Successfully updated port: d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquired lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-fb35f037-ec30-41c1-a7a0-9a0c76820cb3 req-27506715-7853-4e3d-80b0-bf63e65f5512 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received event network-changed-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-fb35f037-ec30-41c1-a7a0-9a0c76820cb3 req-27506715-7853-4e3d-80b0-bf63e65f5512 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Refreshing instance network info cache due to event network-changed-d993aab2-6e2d-410c-9538-d9b0bbcc560d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fb35f037-ec30-41c1-a7a0-9a0c76820cb3 req-27506715-7853-4e3d-80b0-bf63e65f5512 service nova] Acquiring lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updating instance_info_cache with network_info: [{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Releasing lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Updating instance_info_cache with network_info: [{"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Releasing lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Instance network_info: |[{"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fb35f037-ec30-41c1-a7a0-9a0c76820cb3 req-27506715-7853-4e3d-80b0-bf63e65f5512 service nova] Acquired lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.network.neutron [req-fb35f037-ec30-41c1-a7a0-9a0c76820cb3 req-27506715-7853-4e3d-80b0-bf63e65f5512 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Refreshing network info cache for port d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Start _get_guest_xml network_info=[{"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:20:53 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:20:53 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1966686963',display_name='tempest-VolumesSnapshotTestJSON-instance-1966686963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1966686963',id=28,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdUIQapc1tPD5jZPZvpI4QhXAKuY/b6e3WWVDK7rwH8zatqkfka3dvpYzbfJySTTNm7qaDzEw/+PacmsUp6Ig7Pi77TVmCtmNJ1YHGz40LYaa8q0j+eYeKp1c9tuWYn4A==',key_name='tempest-keypair-1211661055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75db810c942649859c59c7e7eb85b96c',ramdisk_id='',reservation_id='r-4nodlwg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1665109562',owner_user_name='tempest-VolumesSnapshotTestJSON-1665109562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e7700a95794faca71c1781b2991241',uuid=1b7f300f-24ac-4b6f-a59b-fc1deb3065c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converting VIF {"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a8:2a,bridge_name='br-int',has_traffic_filtering=True,id=d993aab2-6e2d-410c-9538-d9b0bbcc560d,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd993aab2-6e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:20:53 user nova-compute[73208]:   <uuid>1b7f300f-24ac-4b6f-a59b-fc1deb3065c4</uuid>
Aug 16 09:20:53 user nova-compute[73208]:   <name>instance-0000001c</name>
Aug 16 09:20:53 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:20:53 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:20:53 user nova-compute[73208]:   <metadata>
Aug 16 09:20:53 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:20:53 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:20:53 user nova-compute[73208]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1966686963</nova:name>
Aug 16 09:20:53 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:20:53</nova:creationTime>
Aug 16 09:20:53 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:20:53 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:20:53 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:20:53 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:20:53 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:20:53 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:20:53 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:20:53 user nova-compute[73208]:       <nova:owner>
Aug 16 09:20:53 user nova-compute[73208]:         <nova:user uuid="a5e7700a95794faca71c1781b2991241">tempest-VolumesSnapshotTestJSON-1665109562-project-member</nova:user>
Aug 16 09:20:53 user nova-compute[73208]:         <nova:project uuid="75db810c942649859c59c7e7eb85b96c">tempest-VolumesSnapshotTestJSON-1665109562</nova:project>
Aug 16 09:20:53 user nova-compute[73208]:       </nova:owner>
Aug 16 09:20:53 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:20:53 user nova-compute[73208]:       <nova:ports>
Aug 16 09:20:53 user nova-compute[73208]:         <nova:port uuid="d993aab2-6e2d-410c-9538-d9b0bbcc560d">
Aug 16 09:20:53 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:20:53 user nova-compute[73208]:         </nova:port>
Aug 16 09:20:53 user nova-compute[73208]:       </nova:ports>
Aug 16 09:20:53 user nova-compute[73208]:     </nova:instance>
Aug 16 09:20:53 user nova-compute[73208]:   </metadata>
Aug 16 09:20:53 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:20:53 user nova-compute[73208]:     <system>
Aug 16 09:20:53 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:20:53 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:20:53 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:20:53 user nova-compute[73208]:       <entry name="serial">1b7f300f-24ac-4b6f-a59b-fc1deb3065c4</entry>
Aug 16 09:20:53 user nova-compute[73208]:       <entry name="uuid">1b7f300f-24ac-4b6f-a59b-fc1deb3065c4</entry>
Aug 16 09:20:53 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:20:53 user nova-compute[73208]:     </system>
Aug 16 09:20:53 user nova-compute[73208]:   </sysinfo>
Aug 16 09:20:53 user nova-compute[73208]:   <os>
Aug 16 09:20:53 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:20:53 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:20:53 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:20:53 user nova-compute[73208]:   </os>
Aug 16 09:20:53 user nova-compute[73208]:   <features>
Aug 16 09:20:53 user nova-compute[73208]:     <acpi/>
Aug 16 09:20:53 user nova-compute[73208]:     <apic/>
Aug 16 09:20:53 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:20:53 user nova-compute[73208]:   </features>
Aug 16 09:20:53 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:20:53 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:20:53 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:20:53 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:20:53 user nova-compute[73208]:   </clock>
Aug 16 09:20:53 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:20:53 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:20:53 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:20:53 user nova-compute[73208]:   </cpu>
Aug 16 09:20:53 user nova-compute[73208]:   <devices>
Aug 16 09:20:53 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:20:53 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:20:53 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk"/>
Aug 16 09:20:53 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:20:53 user nova-compute[73208]:     </disk>
Aug 16 09:20:53 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:20:53 user nova-compute[73208]:       <mac address="fa:16:3e:c3:a8:2a"/>
Aug 16 09:20:53 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:20:53 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:20:53 user nova-compute[73208]:       <target dev="tapd993aab2-6e"/>
Aug 16 09:20:53 user nova-compute[73208]:     </interface>
Aug 16 09:20:53 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:20:53 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/console.log" append="off"/>
Aug 16 09:20:53 user nova-compute[73208]:     </serial>
Aug 16 09:20:53 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:20:53 user nova-compute[73208]:     <video>
Aug 16 09:20:53 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:20:53 user nova-compute[73208]:     </video>
Aug 16 09:20:53 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:20:53 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:20:53 user nova-compute[73208]:     </rng>
Aug 16 09:20:53 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:20:53 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:20:53 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:20:53 user nova-compute[73208]:     </memballoon>
Aug 16 09:20:53 user nova-compute[73208]:   </devices>
Aug 16 09:20:53 user nova-compute[73208]: </domain>
Aug 16 09:20:53 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1966686963',display_name='tempest-VolumesSnapshotTestJSON-instance-1966686963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1966686963',id=28,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdUIQapc1tPD5jZPZvpI4QhXAKuY/b6e3WWVDK7rwH8zatqkfka3dvpYzbfJySTTNm7qaDzEw/+PacmsUp6Ig7Pi77TVmCtmNJ1YHGz40LYaa8q0j+eYeKp1c9tuWYn4A==',key_name='tempest-keypair-1211661055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75db810c942649859c59c7e7eb85b96c',ramdisk_id='',reservation_id='r-4nodlwg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1665109562',owner_user_name='tempest-VolumesSnapshotTestJSON-1665109562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e7700a95794faca71c1781b2991241',uuid=1b7f300f-24ac-4b6f-a59b-fc1deb3065c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converting VIF {"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a8:2a,bridge_name='br-int',has_traffic_filtering=True,id=d993aab2-6e2d-410c-9538-d9b0bbcc560d,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd993aab2-6e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG os_vif [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a8:2a,bridge_name='br-int',has_traffic_filtering=True,id=d993aab2-6e2d-410c-9538-d9b0bbcc560d,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd993aab2-6e') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd993aab2-6e, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd993aab2-6e, col_values=(('external_ids', {'iface-id': 'd993aab2-6e2d-410c-9538-d9b0bbcc560d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:a8:2a', 'vm-uuid': '1b7f300f-24ac-4b6f-a59b-fc1deb3065c4'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: INFO os_vif [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a8:2a,bridge_name='br-int',has_traffic_filtering=True,id=d993aab2-6e2d-410c-9538-d9b0bbcc560d,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd993aab2-6e')
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No VIF found with MAC fa:16:3e:c3:a8:2a, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance destroyed successfully.
Aug 16 09:20:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Attempting a stable device rescue
Aug 16 09:20:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73208) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance directory exists: not creating {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 09:20:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Creating image(s)
Aug 16 09:20:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "/opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "/opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG nova.objects.instance [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "7b25a49874f8163ab80acc7b3b22a8e614e33c94" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "7b25a49874f8163ab80acc7b3b22a8e614e33c94" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-fb35f037-ec30-41c1-a7a0-9a0c76820cb3 req-27506715-7853-4e3d-80b0-bf63e65f5512 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Updated VIF entry in instance network info cache for port d993aab2-6e2d-410c-9538-d9b0bbcc560d. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:20:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-fb35f037-ec30-41c1-a7a0-9a0c76820cb3 req-27506715-7853-4e3d-80b0-bf63e65f5512 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Updating instance_info_cache with network_info: [{"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fb35f037-ec30-41c1-a7a0-9a0c76820cb3 req-27506715-7853-4e3d-80b0-bf63e65f5512 service nova] Releasing lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-7498bbce-94dd-4a35-82b5-dd0c04d70a7d req-b85c162e-0689-4f7c-ac0e-2557a993d57f service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7498bbce-94dd-4a35-82b5-dd0c04d70a7d req-b85c162e-0689-4f7c-ac0e-2557a993d57f service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7498bbce-94dd-4a35-82b5-dd0c04d70a7d req-b85c162e-0689-4f7c-ac0e-2557a993d57f service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7498bbce-94dd-4a35-82b5-dd0c04d70a7d req-b85c162e-0689-4f7c-ac0e-2557a993d57f service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-7498bbce-94dd-4a35-82b5-dd0c04d70a7d req-b85c162e-0689-4f7c-ac0e-2557a993d57f service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:55 user nova-compute[73208]: WARNING nova.compute.manager [req-7498bbce-94dd-4a35-82b5-dd0c04d70a7d req-b85c162e-0689-4f7c-ac0e-2557a993d57f service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state rescuing.
Aug 16 09:20:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94.part --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG nova.virt.images [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] acdacd45-dd6c-476c-afcf-740307b9b5e6 was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94.part /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94.part /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94.converted" returned: 0 in 0.312s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "7b25a49874f8163ab80acc7b3b22a8e614e33c94" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.897s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "7b25a49874f8163ab80acc7b3b22a8e614e33c94" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "7b25a49874f8163ab80acc7b3b22a8e614e33c94" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94 --force-share --output=json" returned: 0 in 0.209s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94,backing_fmt=raw /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94,backing_fmt=raw /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue" returned: 0 in 0.055s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "7b25a49874f8163ab80acc7b3b22a8e614e33c94" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'migration_context' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Start _get_guest_xml network_info=[{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "vif_mac": "fa:16:3e:e6:98:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'acdacd45-dd6c-476c-afcf-740307b9b5e6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '589b43f8-f6f6-4eab-b4bd-8d562d95f0a0', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MewZbGpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6b259ec1-e74b-4255-aedf-685818f23c76', 'attached_at': '', 'detached_at': '', 'volume_id': '5176b704-6223-44d3-9ef9-78d7458b0fa7', 'serial': '5176b704-6223-44d3-9ef9-78d7458b0fa7'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'resources' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:56 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:20:56 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:56 user nova-compute[73208]: WARNING nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state rescuing.
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:56 user nova-compute[73208]: WARNING nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state rescuing.
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:56 user nova-compute[73208]: WARNING nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state rescuing.
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:56 user nova-compute[73208]: WARNING nova.compute.manager [req-32de32da-6a39-49ce-ab4f-9dd1154851ea req-1cca48b8-0422-416f-9b88-4fa0d8ba8721 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state rescuing.
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MewZbGpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:20:56 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:20:56 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:20:56 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cd4eb9-53c4-483e-b677-6b228bc73e02]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MewZbGpF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 09:20:56 user nova-compute[73208]: node.name = iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7
Aug 16 09:20:56 user nova-compute[73208]: node.tpgt = -1
Aug 16 09:20:56 user nova-compute[73208]: node.startup = automatic
Aug 16 09:20:56 user nova-compute[73208]: node.leading_login = No
Aug 16 09:20:56 user nova-compute[73208]: iface.iscsi_ifacename = default
Aug 16 09:20:56 user nova-compute[73208]: iface.net_ifacename = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.ipaddress = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.prefix_len = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.hwaddress = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.transport_name = tcp
Aug 16 09:20:56 user nova-compute[73208]: iface.initiatorname = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.state = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.vlan_id = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.vlan_priority = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.vlan_state = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.iface_num = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.mtu = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.port = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.bootproto = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.subnet_mask = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.gateway = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.dhcp_alt_client_id = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.dhcp_dns = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.dhcp_learn_iqn = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.dhcp_vendor_id_state = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.dhcp_vendor_id = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.dhcp_slp_da = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.fragmentation = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.gratuitous_arp = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.incoming_forwarding = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.tos_state = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.tos = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.ttl = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.delayed_ack = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.tcp_nagle = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.tcp_wsf_state = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.tcp_wsf = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.tcp_timer_scale = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.tcp_timestamp = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.redirect = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.def_task_mgmt_timeout = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.header_digest = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.data_digest = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.immediate_data = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.initial_r2t = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.data_seq_inorder = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.data_pdu_inorder = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.erl = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.max_receive_data_len = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.first_burst_len = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.max_outstanding_r2t = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.max_burst_len = 0
Aug 16 09:20:56 user nova-compute[73208]: iface.chap_auth = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.bidi_chap = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.strict_login_compliance = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.discovery_auth = <empty>
Aug 16 09:20:56 user nova-compute[73208]: iface.discovery_logout = <empty>
Aug 16 09:20:56 user nova-compute[73208]: node.discovery_address = <empty>
Aug 16 09:20:56 user nova-compute[73208]: node.discovery_port = 0
Aug 16 09:20:56 user nova-compute[73208]: node.discovery_type = static
Aug 16 09:20:56 user nova-compute[73208]: node.session.initial_cmdsn = 0
Aug 16 09:20:56 user nova-compute[73208]: node.session.initial_login_retry_max = 8
Aug 16 09:20:56 user nova-compute[73208]: node.session.xmit_thread_priority = -20
Aug 16 09:20:56 user nova-compute[73208]: node.session.cmds_max = 128
Aug 16 09:20:56 user nova-compute[73208]: node.session.queue_depth = 32
Aug 16 09:20:56 user nova-compute[73208]: node.session.nr_sessions = 1
Aug 16 09:20:56 user nova-compute[73208]: node.session.auth.authmethod = CHAP
Aug 16 09:20:56 user nova-compute[73208]: node.session.auth.username = MewZbGpF
Aug 16 09:20:56 user nova-compute[73208]: node.session.auth.password = ***
Aug 16 09:20:56 user nova-compute[73208]: node.session.auth.username_in = <empty>
Aug 16 09:20:56 user nova-compute[73208]: node.session.auth.password_in = <empty>
Aug 16 09:20:56 user nova-compute[73208]: node.session.auth.chap_algs = MD5
Aug 16 09:20:56 user nova-compute[73208]: node.session.timeo.replacement_timeout = 120
Aug 16 09:20:56 user nova-compute[73208]: node.session.err_timeo.abort_timeout = 15
Aug 16 09:20:56 user nova-compute[73208]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 09:20:56 user nova-compute[73208]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 09:20:56 user nova-compute[73208]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.FastAbort = Yes
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.InitialR2T = No
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.ImmediateData = Yes
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.MaxConnections = 1
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 09:20:56 user nova-compute[73208]: node.session.iscsi.ERL = 0
Aug 16 09:20:56 user nova-compute[73208]: node.session.scan = manual
Aug 16 09:20:56 user nova-compute[73208]: node.session.reopen_max = 0
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].address = 172.16.0.220
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].port = 3260
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].startup = manual
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].tcp.window_size = 524288
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].tcp.type_of_service = 0
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].timeo.logout_timeout = 15
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].timeo.login_timeout = 15
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].timeo.auth_timeout = 45
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].iscsi.DataDigest = None
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].iscsi.IFMarker = No
Aug 16 09:20:56 user nova-compute[73208]: node.conn[0].iscsi.OFMarker = No
Aug 16 09:20:56 user nova-compute[73208]: # END RECORD
Aug 16 09:20:56 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6433f0-b4e2-4e07-a620-d3237a4edd98]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[901b2d52-841d-45a9-827e-d25adc680aad]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MewZbGpF {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MewZbGpF" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b888a-0c50-47ce-b5ca-f7af0ac12be0]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MewZbGpF'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9966e9-3e8c-4ad8-abd8-cc4cd9767067]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dae5e2-7f27-4a75-9fd0-bc9b165edb96]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:56 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:56 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:20:56 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:20:56 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.164s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] HCTL ('34', '0', '0', 0) found on session 26 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdcf1ee-61dd-4301-b703-20a4c83752d3]: (4, ('0 0 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching for a device in session 26 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MewZbGpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23161646361343837', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161646361343837', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-225187500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-225187500',id=27,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-oar6memn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:19:23Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=6b259ec1-e74b-4255-aedf-685818f23c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "vif_mac": "fa:16:3e:e6:98:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "vif_mac": "fa:16:3e:e6:98:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:98:27,bridge_name='br-int',has_traffic_filtering=True,id=94c240e8-e39e-4f10-ba85-8d3e4126a2a4,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c240e8-e3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:20:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:20:56 user nova-compute[73208]:   <uuid>6b259ec1-e74b-4255-aedf-685818f23c76</uuid>
Aug 16 09:20:56 user nova-compute[73208]:   <name>instance-0000001b</name>
Aug 16 09:20:56 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:20:56 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:20:56 user nova-compute[73208]:   <metadata>
Aug 16 09:20:56 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:20:56 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:20:56 user nova-compute[73208]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-225187500</nova:name>
Aug 16 09:20:56 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:20:56</nova:creationTime>
Aug 16 09:20:56 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:20:56 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:20:56 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:20:56 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:20:56 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:20:56 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:20:56 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:20:56 user nova-compute[73208]:       <nova:owner>
Aug 16 09:20:56 user nova-compute[73208]:         <nova:user uuid="91255b4dbf814537906275122738afcf">tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member</nova:user>
Aug 16 09:20:56 user nova-compute[73208]:         <nova:project uuid="a5da0d7fd51c4dcaba48f74dc423e684">tempest-ServerBootFromVolumeStableRescueTest-1980932529</nova:project>
Aug 16 09:20:56 user nova-compute[73208]:       </nova:owner>
Aug 16 09:20:56 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:20:56 user nova-compute[73208]:       <nova:ports>
Aug 16 09:20:56 user nova-compute[73208]:         <nova:port uuid="94c240e8-e39e-4f10-ba85-8d3e4126a2a4">
Aug 16 09:20:56 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 09:20:56 user nova-compute[73208]:         </nova:port>
Aug 16 09:20:56 user nova-compute[73208]:       </nova:ports>
Aug 16 09:20:56 user nova-compute[73208]:     </nova:instance>
Aug 16 09:20:56 user nova-compute[73208]:   </metadata>
Aug 16 09:20:56 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:20:56 user nova-compute[73208]:     <system>
Aug 16 09:20:56 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:20:56 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:20:56 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:20:56 user nova-compute[73208]:       <entry name="serial">6b259ec1-e74b-4255-aedf-685818f23c76</entry>
Aug 16 09:20:56 user nova-compute[73208]:       <entry name="uuid">6b259ec1-e74b-4255-aedf-685818f23c76</entry>
Aug 16 09:20:56 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:20:56 user nova-compute[73208]:     </system>
Aug 16 09:20:56 user nova-compute[73208]:   </sysinfo>
Aug 16 09:20:56 user nova-compute[73208]:   <os>
Aug 16 09:20:56 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:20:56 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:20:56 user nova-compute[73208]:   </os>
Aug 16 09:20:56 user nova-compute[73208]:   <features>
Aug 16 09:20:56 user nova-compute[73208]:     <acpi/>
Aug 16 09:20:56 user nova-compute[73208]:     <apic/>
Aug 16 09:20:56 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:20:56 user nova-compute[73208]:   </features>
Aug 16 09:20:56 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:20:56 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:20:56 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:20:56 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:20:56 user nova-compute[73208]:   </clock>
Aug 16 09:20:56 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:20:56 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:20:56 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:20:56 user nova-compute[73208]:   </cpu>
Aug 16 09:20:56 user nova-compute[73208]:   <devices>
Aug 16 09:20:56 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:20:56 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:20:56 user nova-compute[73208]:       <source dev="/dev/sdc"/>
Aug 16 09:20:56 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:20:56 user nova-compute[73208]:       <serial>5176b704-6223-44d3-9ef9-78d7458b0fa7</serial>
Aug 16 09:20:56 user nova-compute[73208]:     </disk>
Aug 16 09:20:56 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:20:56 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:20:56 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue"/>
Aug 16 09:20:56 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:20:56 user nova-compute[73208]:       <boot order="1"/>
Aug 16 09:20:56 user nova-compute[73208]:     </disk>
Aug 16 09:20:56 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:20:56 user nova-compute[73208]:       <mac address="fa:16:3e:e6:98:27"/>
Aug 16 09:20:56 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:20:56 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:20:56 user nova-compute[73208]:       <target dev="tap94c240e8-e3"/>
Aug 16 09:20:56 user nova-compute[73208]:     </interface>
Aug 16 09:20:56 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:20:56 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/console.log" append="off"/>
Aug 16 09:20:56 user nova-compute[73208]:     </serial>
Aug 16 09:20:56 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:20:56 user nova-compute[73208]:     <video>
Aug 16 09:20:56 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:20:56 user nova-compute[73208]:     </video>
Aug 16 09:20:56 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:20:56 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:20:56 user nova-compute[73208]:     </rng>
Aug 16 09:20:56 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:20:56 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:20:56 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:20:56 user nova-compute[73208]:     </memballoon>
Aug 16 09:20:56 user nova-compute[73208]:   </devices>
Aug 16 09:20:56 user nova-compute[73208]: </domain>
Aug 16 09:20:56 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:20:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance destroyed successfully.
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No VIF found with MAC fa:16:3e:e6:98:27, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177657.8277164, 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:20:57 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] VM Resumed (Lifecycle Event)
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:57 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Instance spawned successfully.
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:20:57 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177657.8294015, 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:20:57 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] VM Started (Lifecycle Event)
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:20:57 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:20:57 user nova-compute[73208]: INFO nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Took 7.71 seconds to spawn the instance on the hypervisor.
Aug 16 09:20:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:20:58 user nova-compute[73208]: INFO nova.compute.manager [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Took 8.49 seconds to build instance.
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0b69944-e263-415e-bfe4-36ae1df3798a tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.595s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:20:58 user nova-compute[73208]: INFO nova.compute.claims [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Claim successful on node user
Aug 16 09:20:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:58 user nova-compute[73208]: WARNING nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state rescuing.
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received event network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] No waiting events found dispatching network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:58 user nova-compute[73208]: WARNING nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received unexpected event network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d for instance with vm_state active and task_state None.
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received event network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] No waiting events found dispatching network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:20:58 user nova-compute[73208]: WARNING nova.compute.manager [req-3d5b63b0-6659-4da0-a147-f57e2a1050b2 req-fce1c2f5-2cf8-42f7-915d-e20ff0918697 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received unexpected event network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d for instance with vm_state active and task_state None.
Aug 16 09:20:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:20:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:20:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:20:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG nova.policy [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18737770cdee43d6a782ebbbd311e8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12301729e76a42afa0c8923d3d428cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:20:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Creating image(s)
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "/opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "/opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.207s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.218s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk 1073741824" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.423s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:20:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.246s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Cannot resize image /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'migration_context' on Instance uuid ce7f5083-c390-4418-9e65-5abc231a12fc {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Ensure instance console log exists: /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Successfully created port: 52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:21:00 user nova-compute[73208]: WARNING nova.compute.manager [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state rescuing.
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:21:00 user nova-compute[73208]: WARNING nova.compute.manager [req-6c099f46-b2a8-4975-ac63-3db2a015d077 req-e2f12bf2-9fcb-49af-b469-c11913eb48a0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state rescuing.
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for 6b259ec1-e74b-4255-aedf-685818f23c76 due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:21:00 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177660.9928367, 6b259ec1-e74b-4255-aedf-685818f23c76 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:21:00 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] VM Resumed (Lifecycle Event)
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-87ad2974-b2c7-41e4-a93a-24c0218f2c61 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:21:01 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177660.9947653, 6b259ec1-e74b-4255-aedf-685818f23c76 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:21:01 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] VM Started (Lifecycle Event)
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:01 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Successfully updated port: 52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquired lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-71a478dd-44a2-4ea7-a1d2-014d8104fe0c req-d483d8be-a60b-46e3-95b4-29bf5aa8c4c6 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received event network-changed-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-71a478dd-44a2-4ea7-a1d2-014d8104fe0c req-d483d8be-a60b-46e3-95b4-29bf5aa8c4c6 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Refreshing instance network info cache due to event network-changed-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-71a478dd-44a2-4ea7-a1d2-014d8104fe0c req-d483d8be-a60b-46e3-95b4-29bf5aa8c4c6 service nova] Acquiring lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:01 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Updating instance_info_cache with network_info: [{"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Releasing lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Instance network_info: |[{"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-71a478dd-44a2-4ea7-a1d2-014d8104fe0c req-d483d8be-a60b-46e3-95b4-29bf5aa8c4c6 service nova] Acquired lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.network.neutron [req-71a478dd-44a2-4ea7-a1d2-014d8104fe0c req-d483d8be-a60b-46e3-95b4-29bf5aa8c4c6 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Refreshing network info cache for port 52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Start _get_guest_xml network_info=[{"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:21:02 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:21:02 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2025661843',display_name='tempest-AttachVolumeNegativeTest-server-2025661843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2025661843',id=29,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0nVPsu6kLI4GOq5/5QeVZEH7rEOoya5tI81bsTJRr5VU5UFL/thOwn3L60wTFc8ZD0clweReqGJ9eYDeJSHwSNJv/DtRCSSJ0wBvN0pkQzcCCcrOz0wuruoWOZkZQZLA==',key_name='tempest-keypair-1925335469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-xug0dp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=ce7f5083-c390-4418-9e65-5abc231a12fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:22:dc,bridge_name='br-int',has_traffic_filtering=True,id=52bb4dbc-e48d-42dc-a0c7-facb91fd42bd,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bb4dbc-e4') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'pci_devices' on Instance uuid ce7f5083-c390-4418-9e65-5abc231a12fc {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:21:02 user nova-compute[73208]:   <uuid>ce7f5083-c390-4418-9e65-5abc231a12fc</uuid>
Aug 16 09:21:02 user nova-compute[73208]:   <name>instance-0000001d</name>
Aug 16 09:21:02 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:21:02 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:21:02 user nova-compute[73208]:   <metadata>
Aug 16 09:21:02 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:21:02 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:21:02 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2025661843</nova:name>
Aug 16 09:21:02 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:21:02</nova:creationTime>
Aug 16 09:21:02 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:21:02 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:21:02 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:21:02 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:21:02 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:21:02 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:21:02 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:21:02 user nova-compute[73208]:       <nova:owner>
Aug 16 09:21:02 user nova-compute[73208]:         <nova:user uuid="18737770cdee43d6a782ebbbd311e8fc">tempest-AttachVolumeNegativeTest-657236303-project-member</nova:user>
Aug 16 09:21:02 user nova-compute[73208]:         <nova:project uuid="12301729e76a42afa0c8923d3d428cac">tempest-AttachVolumeNegativeTest-657236303</nova:project>
Aug 16 09:21:02 user nova-compute[73208]:       </nova:owner>
Aug 16 09:21:02 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:21:02 user nova-compute[73208]:       <nova:ports>
Aug 16 09:21:02 user nova-compute[73208]:         <nova:port uuid="52bb4dbc-e48d-42dc-a0c7-facb91fd42bd">
Aug 16 09:21:02 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 09:21:02 user nova-compute[73208]:         </nova:port>
Aug 16 09:21:02 user nova-compute[73208]:       </nova:ports>
Aug 16 09:21:02 user nova-compute[73208]:     </nova:instance>
Aug 16 09:21:02 user nova-compute[73208]:   </metadata>
Aug 16 09:21:02 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:21:02 user nova-compute[73208]:     <system>
Aug 16 09:21:02 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:21:02 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:21:02 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:21:02 user nova-compute[73208]:       <entry name="serial">ce7f5083-c390-4418-9e65-5abc231a12fc</entry>
Aug 16 09:21:02 user nova-compute[73208]:       <entry name="uuid">ce7f5083-c390-4418-9e65-5abc231a12fc</entry>
Aug 16 09:21:02 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:21:02 user nova-compute[73208]:     </system>
Aug 16 09:21:02 user nova-compute[73208]:   </sysinfo>
Aug 16 09:21:02 user nova-compute[73208]:   <os>
Aug 16 09:21:02 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:21:02 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:21:02 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:21:02 user nova-compute[73208]:   </os>
Aug 16 09:21:02 user nova-compute[73208]:   <features>
Aug 16 09:21:02 user nova-compute[73208]:     <acpi/>
Aug 16 09:21:02 user nova-compute[73208]:     <apic/>
Aug 16 09:21:02 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:21:02 user nova-compute[73208]:   </features>
Aug 16 09:21:02 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:21:02 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:21:02 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:21:02 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:21:02 user nova-compute[73208]:   </clock>
Aug 16 09:21:02 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:21:02 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:21:02 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:21:02 user nova-compute[73208]:   </cpu>
Aug 16 09:21:02 user nova-compute[73208]:   <devices>
Aug 16 09:21:02 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:21:02 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:21:02 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk"/>
Aug 16 09:21:02 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:21:02 user nova-compute[73208]:     </disk>
Aug 16 09:21:02 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:21:02 user nova-compute[73208]:       <mac address="fa:16:3e:ff:22:dc"/>
Aug 16 09:21:02 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:21:02 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:21:02 user nova-compute[73208]:       <target dev="tap52bb4dbc-e4"/>
Aug 16 09:21:02 user nova-compute[73208]:     </interface>
Aug 16 09:21:02 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:21:02 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/console.log" append="off"/>
Aug 16 09:21:02 user nova-compute[73208]:     </serial>
Aug 16 09:21:02 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:21:02 user nova-compute[73208]:     <video>
Aug 16 09:21:02 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:21:02 user nova-compute[73208]:     </video>
Aug 16 09:21:02 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:21:02 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:21:02 user nova-compute[73208]:     </rng>
Aug 16 09:21:02 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:21:02 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:21:02 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:21:02 user nova-compute[73208]:     </memballoon>
Aug 16 09:21:02 user nova-compute[73208]:   </devices>
Aug 16 09:21:02 user nova-compute[73208]: </domain>
Aug 16 09:21:02 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2025661843',display_name='tempest-AttachVolumeNegativeTest-server-2025661843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2025661843',id=29,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0nVPsu6kLI4GOq5/5QeVZEH7rEOoya5tI81bsTJRr5VU5UFL/thOwn3L60wTFc8ZD0clweReqGJ9eYDeJSHwSNJv/DtRCSSJ0wBvN0pkQzcCCcrOz0wuruoWOZkZQZLA==',key_name='tempest-keypair-1925335469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-xug0dp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=ce7f5083-c390-4418-9e65-5abc231a12fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:22:dc,bridge_name='br-int',has_traffic_filtering=True,id=52bb4dbc-e48d-42dc-a0c7-facb91fd42bd,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bb4dbc-e4') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG os_vif [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:22:dc,bridge_name='br-int',has_traffic_filtering=True,id=52bb4dbc-e48d-42dc-a0c7-facb91fd42bd,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bb4dbc-e4') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52bb4dbc-e4, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52bb4dbc-e4, col_values=(('external_ids', {'iface-id': '52bb4dbc-e48d-42dc-a0c7-facb91fd42bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:22:dc', 'vm-uuid': 'ce7f5083-c390-4418-9e65-5abc231a12fc'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:02 user nova-compute[73208]: INFO os_vif [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:22:dc,bridge_name='br-int',has_traffic_filtering=True,id=52bb4dbc-e48d-42dc-a0c7-facb91fd42bd,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bb4dbc-e4')
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No VIF found with MAC fa:16:3e:ff:22:dc, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.network.neutron [req-71a478dd-44a2-4ea7-a1d2-014d8104fe0c req-d483d8be-a60b-46e3-95b4-29bf5aa8c4c6 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Updated VIF entry in instance network info cache for port 52bb4dbc-e48d-42dc-a0c7-facb91fd42bd. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG nova.network.neutron [req-71a478dd-44a2-4ea7-a1d2-014d8104fe0c req-d483d8be-a60b-46e3-95b4-29bf5aa8c4c6 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Updating instance_info_cache with network_info: [{"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-71a478dd-44a2-4ea7-a1d2-014d8104fe0c req-d483d8be-a60b-46e3-95b4-29bf5aa8c4c6 service nova] Releasing lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-56637c8e-980d-4e19-a2ec-2a8f04a5c9c1 req-aafb2847-d9a0-4ed0-b56a-3db09890e198 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received event network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-56637c8e-980d-4e19-a2ec-2a8f04a5c9c1 req-aafb2847-d9a0-4ed0-b56a-3db09890e198 service nova] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-56637c8e-980d-4e19-a2ec-2a8f04a5c9c1 req-aafb2847-d9a0-4ed0-b56a-3db09890e198 service nova] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-56637c8e-980d-4e19-a2ec-2a8f04a5c9c1 req-aafb2847-d9a0-4ed0-b56a-3db09890e198 service nova] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-56637c8e-980d-4e19-a2ec-2a8f04a5c9c1 req-aafb2847-d9a0-4ed0-b56a-3db09890e198 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] No waiting events found dispatching network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:21:04 user nova-compute[73208]: WARNING nova.compute.manager [req-56637c8e-980d-4e19-a2ec-2a8f04a5c9c1 req-aafb2847-d9a0-4ed0-b56a-3db09890e198 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received unexpected event network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd for instance with vm_state building and task_state spawning.
Aug 16 09:21:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177666.244715, ce7f5083-c390-4418-9e65-5abc231a12fc => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:21:06 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] VM Resumed (Lifecycle Event)
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:21:06 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Instance spawned successfully.
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:21:06 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177666.249897, ce7f5083-c390-4418-9e65-5abc231a12fc => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:21:06 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] VM Started (Lifecycle Event)
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:21:06 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:21:06 user nova-compute[73208]: INFO nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Took 7.17 seconds to spawn the instance on the hypervisor.
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-369c54de-f227-4326-bd49-1960da1287c8 req-5890a613-834d-4076-ac54-65a025f248f5 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received event network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-369c54de-f227-4326-bd49-1960da1287c8 req-5890a613-834d-4076-ac54-65a025f248f5 service nova] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-369c54de-f227-4326-bd49-1960da1287c8 req-5890a613-834d-4076-ac54-65a025f248f5 service nova] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-369c54de-f227-4326-bd49-1960da1287c8 req-5890a613-834d-4076-ac54-65a025f248f5 service nova] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-369c54de-f227-4326-bd49-1960da1287c8 req-5890a613-834d-4076-ac54-65a025f248f5 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] No waiting events found dispatching network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:21:06 user nova-compute[73208]: WARNING nova.compute.manager [req-369c54de-f227-4326-bd49-1960da1287c8 req-5890a613-834d-4076-ac54-65a025f248f5 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received unexpected event network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd for instance with vm_state building and task_state spawning.
Aug 16 09:21:06 user nova-compute[73208]: INFO nova.compute.manager [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Took 8.36 seconds to build instance.
Aug 16 09:21:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f1b8cd19-ff2f-4017-884e-b4ea8b439995 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.510s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-1450b0b3-0d6a-4dcf-831e-efdb4bead16f req-c1a44645-3d4c-4bd5-962e-f678d2a297ba service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-changed-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-1450b0b3-0d6a-4dcf-831e-efdb4bead16f req-c1a44645-3d4c-4bd5-962e-f678d2a297ba service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Refreshing instance network info cache due to event network-changed-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1450b0b3-0d6a-4dcf-831e-efdb4bead16f req-c1a44645-3d4c-4bd5-962e-f678d2a297ba service nova] Acquiring lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1450b0b3-0d6a-4dcf-831e-efdb4bead16f req-c1a44645-3d4c-4bd5-962e-f678d2a297ba service nova] Acquired lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG nova.network.neutron [req-1450b0b3-0d6a-4dcf-831e-efdb4bead16f req-c1a44645-3d4c-4bd5-962e-f678d2a297ba service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Refreshing network info cache for port d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:23 user nova-compute[73208]: INFO nova.compute.manager [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Terminating instance
Aug 16 09:21:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG nova.network.neutron [req-1450b0b3-0d6a-4dcf-831e-efdb4bead16f req-c1a44645-3d4c-4bd5-962e-f678d2a297ba service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updated VIF entry in instance network info cache for port d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG nova.network.neutron [req-1450b0b3-0d6a-4dcf-831e-efdb4bead16f req-c1a44645-3d4c-4bd5-962e-f678d2a297ba service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updating instance_info_cache with network_info: [{"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1450b0b3-0d6a-4dcf-831e-efdb4bead16f req-c1a44645-3d4c-4bd5-962e-f678d2a297ba service nova] Releasing lock "refresh_cache-294850cd-624e-45df-b26b-18981a4ef2f2" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:24 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Instance destroyed successfully.
Aug 16 09:21:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'resources' on Instance uuid 294850cd-624e-45df-b26b-18981a4ef2f2 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-310032303',display_name='tempest-TestStampPattern-server-310032303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-310032303',id=25,image_ref='8aefa061-2d4f-4cb2-aa4f-f4e0509c7955',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFP34sDs4CLYmubLSC4kCMpHtWHceMAeRCdklXcRBkRvJzGIHCzM0kgKwFuU1BnHR9jMIwv0gvQmT5STpCWuKJTa9HncMQEEcyd0scFYwDrZm/j986rVnynsvKDg7Y+KA==',key_name='tempest-TestStampPattern-2113117152',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:18:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='deeb19a8593540b48b0954bad0f1a0fb',ramdisk_id='',reservation_id='r-eypd63so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e8646f12-ea4a-4ba2-81e4-b4d9323f13ff',image_min_disk='1',image_min_ram='0',image_owner_id='deeb19a8593540b48b0954bad0f1a0fb',image_owner_project_name='tempest-TestStampPattern-1918763131',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1918763131-project-member',image_user_id='5b7f7948212d4084b5599646e2486136',owner_project_name='tempest-TestStampPattern-1918763131',owner_user_name='tempest-TestStampPattern-1918763131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:18:32Z,user_data=None,user_id='5b7f7948212d4084b5599646e2486136',uuid=294850cd-624e-45df-b26b-18981a4ef2f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converting VIF {"id": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "address": "fa:16:3e:90:4e:9f", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e1cc07-e2", "ovs_interfaceid": "d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:4e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1cc07-e2') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG os_vif [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:4e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1cc07-e2') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3e1cc07-e2, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:24 user nova-compute[73208]: INFO os_vif [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:4e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e1cc07-e2')
Aug 16 09:21:24 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Deleting instance files /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2_del
Aug 16 09:21:24 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Deletion of /opt/stack/data/nova/instances/294850cd-624e-45df-b26b-18981a4ef2f2_del complete
Aug 16 09:21:24 user nova-compute[73208]: INFO nova.compute.manager [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 09:21:24 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:21:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:25 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Took 0.95 seconds to deallocate network for instance.
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-9fe5058d-acea-4090-a46d-34724bd0c5d9 req-8b04484f-a985-498c-bc10-be6b065031b3 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-vif-deleted-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:25 user nova-compute[73208]: INFO nova.compute.manager [req-9fe5058d-acea-4090-a46d-34724bd0c5d9 req-8b04484f-a985-498c-bc10-be6b065031b3 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Neutron deleted interface d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf; detaching it from the instance and deleting it from the info cache
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.network.neutron [req-9fe5058d-acea-4090-a46d-34724bd0c5d9 req-8b04484f-a985-498c-bc10-be6b065031b3 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-vif-unplugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] No waiting events found dispatching network-vif-unplugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-vif-unplugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received event network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] Acquiring lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] Lock "294850cd-624e-45df-b26b-18981a4ef2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] No waiting events found dispatching network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:21:25 user nova-compute[73208]: WARNING nova.compute.manager [req-c39519f2-3d00-46f3-84be-e1d75706baa4 req-340be567-7e64-484a-99f5-da9b9f95829d service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Received unexpected event network-vif-plugged-d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf for instance with vm_state active and task_state deleting.
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-9fe5058d-acea-4090-a46d-34724bd0c5d9 req-8b04484f-a985-498c-bc10-be6b065031b3 service nova] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Detach interface failed, port_id=d3e1cc07-e2d4-420b-80a7-7dc2cb0705cf, reason: Instance 294850cd-624e-45df-b26b-18981a4ef2f2 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:25 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Deleted allocations for instance 294850cd-624e-45df-b26b-18981a4ef2f2
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-758279ae-35c4-4f4d-b42a-350012817275 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "294850cd-624e-45df-b26b-18981a4ef2f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.529s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:21:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7471MB free_disk=25.301048278808594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Applying migration context for instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 as it has an incoming, in-progress migration 92cbc669-881b-4078-8424-dbdbb0c280eb. Migration status is finished {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 09:21:28 user nova-compute[73208]: INFO nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating resource usage from migration 92cbc669-881b-4078-8424-dbdbb0c280eb
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Migration 92cbc669-881b-4078-8424-dbdbb0c280eb is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ce7f5083-c390-4418-9e65-5abc231a12fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:21:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:29 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:21:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:21:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:31 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:21:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updating instance_info_cache with network_info: [{"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:21:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:21:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:39 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177684.0167837, 294850cd-624e-45df-b26b-18981a4ef2f2 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:21:39 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] VM Stopped (Lifecycle Event)
Aug 16 09:21:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-9a6dcf92-f3d7-432a-967d-ce20a6787a26 None None] [instance: 294850cd-624e-45df-b26b-18981a4ef2f2] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:21:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:21:48 user nova-compute[73208]: INFO nova.compute.claims [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Claim successful on node user
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:21:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:21:48 user nova-compute[73208]: INFO nova.virt.block_device [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Booting with volume 0b7b75c9-8778-4a6d-8067-0f86f0183c84 at /dev/vda
Aug 16 09:21:48 user nova-compute[73208]: DEBUG os_brick.utils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.policy [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '974df5dc0b2a47e29d9471875a21b7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc1ea26bbdd41828ba691969efeb5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef35c7f5-fd41-4934-87f7-53c384ed44c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead827ad-5dde-4290-8f7e-4a152ae49caa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8467f47-9531-4923-904a-8d163463501b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce68361-a1ba-4f38-9974-08b04c3070ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:21:48 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:21:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccfa4e4-0dc6-4bab-8ed7-1331e7f261bc]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG os_brick.utils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:21:48 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating existing volume attachment record: c5888c25-47c2-4f51-ad09-140ac80654d8 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:21:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:21:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully created port: 52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:21:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully created port: 43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:21:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully created port: 1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:21:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully created port: 7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:21:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully created port: 929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:21:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully updated port: 52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:21:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-4ab664d6-aff2-45a7-b0a1-c4c70da482d7 req-77d44fe0-a4b9-45bd-8495-03e6ecfc79ae service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-changed-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-4ab664d6-aff2-45a7-b0a1-c4c70da482d7 req-77d44fe0-a4b9-45bd-8495-03e6ecfc79ae service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing instance network info cache due to event network-changed-52a7ad9a-8d25-4e56-8341-09d8e5d63f97. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:21:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4ab664d6-aff2-45a7-b0a1-c4c70da482d7 req-77d44fe0-a4b9-45bd-8495-03e6ecfc79ae service nova] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4ab664d6-aff2-45a7-b0a1-c4c70da482d7 req-77d44fe0-a4b9-45bd-8495-03e6ecfc79ae service nova] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-4ab664d6-aff2-45a7-b0a1-c4c70da482d7 req-77d44fe0-a4b9-45bd-8495-03e6ecfc79ae service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing network info cache for port 52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:21:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-4ab664d6-aff2-45a7-b0a1-c4c70da482d7 req-77d44fe0-a4b9-45bd-8495-03e6ecfc79ae service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:21:53 user nova-compute[73208]: DEBUG nova.network.neutron [req-4ab664d6-aff2-45a7-b0a1-c4c70da482d7 req-77d44fe0-a4b9-45bd-8495-03e6ecfc79ae service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4ab664d6-aff2-45a7-b0a1-c4c70da482d7 req-77d44fe0-a4b9-45bd-8495-03e6ecfc79ae service nova] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully updated port: da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully updated port: a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-changed-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing instance network info cache due to event network-changed-da74aba8-33f2-4275-aba9-e6a9e5c3cee2. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing network info cache for port da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-changed-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing instance network info cache due to event network-changed-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing network info cache for port a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:21:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG nova.network.neutron [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55a6b426-b98b-4047-92fc-5aa56f03344e req-299a3ef1-dbb6-4cfd-93bc-9a80813ca892 service nova] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully updated port: 43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Going to confirm migration 2 {{(pid=73208) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquired lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:21:55 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'info_cache' on Instance uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-241a3611-7622-4b05-b97b-fdda1ca3ff1c req-0aaa7858-b240-43db-9346-b9bb42bb061a service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-changed-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-241a3611-7622-4b05-b97b-fdda1ca3ff1c req-0aaa7858-b240-43db-9346-b9bb42bb061a service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing instance network info cache due to event network-changed-43bd38d9-43ea-4cbe-a19c-7c223489ff4f. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-241a3611-7622-4b05-b97b-fdda1ca3ff1c req-0aaa7858-b240-43db-9346-b9bb42bb061a service nova] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-241a3611-7622-4b05-b97b-fdda1ca3ff1c req-0aaa7858-b240-43db-9346-b9bb42bb061a service nova] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-241a3611-7622-4b05-b97b-fdda1ca3ff1c req-0aaa7858-b240-43db-9346-b9bb42bb061a service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing network info cache for port 43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating instance_info_cache with network_info: [{"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-241a3611-7622-4b05-b97b-fdda1ca3ff1c req-0aaa7858-b240-43db-9346-b9bb42bb061a service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Releasing lock "refresh_cache-00e2e59e-60e2-4833-8ca1-26a41dad5ea1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'migration_context' on Instance uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully updated port: 1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:21:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:21:57 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:21:57 user nova-compute[73208]: DEBUG nova.network.neutron [req-241a3611-7622-4b05-b97b-fdda1ca3ff1c req-0aaa7858-b240-43db-9346-b9bb42bb061a service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:21:57 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:21:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-241a3611-7622-4b05-b97b-fdda1ca3ff1c req-0aaa7858-b240-43db-9346-b9bb42bb061a service nova] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:21:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.353s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:57 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Deleted allocation for migration 92cbc669-881b-4078-8424-dbdbb0c280eb
Aug 16 09:21:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0c1a1f5-61e8-43f2-a901-262c953f2275 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.740s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:21:57 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully updated port: 7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:21:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Successfully updated port: 929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:21:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:21:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:21:58 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:21:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-changed-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:21:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing instance network info cache due to event network-changed-1de5138b-21d7-429a-ab10-056116c3d4dc. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:21:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:21:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:21:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:21:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:21:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:21:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:21:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:00 user nova-compute[73208]: DEBUG nova.network.neutron [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance network_info: |[{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:22:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:22:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing network info cache for port 1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updated VIF entry in instance network info cache for port 1de5138b-21d7-429a-ab10-056116c3d4dc. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-changed-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing instance network info cache due to event network-changed-7c0d2f58-470c-44d2-8162-2a75697a5200. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing network info cache for port 7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updated VIF entry in instance network info cache for port 7c0d2f58-470c-44d2-8162-2a75697a5200. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-changed-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing instance network info cache due to event network-changed-929e2681-835d-416b-9c55-3afe6319bdfb. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing network info cache for port 929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updated VIF entry in instance network info cache for port 929e2681-835d-416b-9c55-3afe6319bdfb. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG nova.network.neutron [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c8db75db-91b3-40f1-ae6f-6245a2b1f2a3 req-b3a0d53e-0e25-4530-ba6f-6e365d1e3a2f service nova] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:18 user nova-compute[73208]: INFO nova.virt.block_device [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Booting with volume fcd02a00-6787-485e-b93e-9c54c146b8be at /dev/vdb
Aug 16 09:22:18 user nova-compute[73208]: DEBUG os_brick.utils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a180b64d-99cf-4f2e-94d8-8f636a3db47e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa140a0-6b1e-40a7-a457-4ecb729a7d40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b6a73a-2923-458b-ac93-8bc404e20e33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c698afd-3419-4f68-b298-a348fece8233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:22:18 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:22:18 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eef5f7-3f0a-46a5-9529-e7f0adbc915a]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG os_brick.utils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:22:18 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating existing volume attachment record: 658eafd6-79cb-475c-8545-9d5c1c1ad430 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:22:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:22:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-e740bbce-a947-423c-af1c-21a850d1611c req-7d1561ff-d133-4c19-9a53-169e97f38c84 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-changed-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-e740bbce-a947-423c-af1c-21a850d1611c req-7d1561ff-d133-4c19-9a53-169e97f38c84 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Refreshing instance network info cache due to event network-changed-7d90a76c-2029-41ac-bbba-a6119c69521d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e740bbce-a947-423c-af1c-21a850d1611c req-7d1561ff-d133-4c19-9a53-169e97f38c84 service nova] Acquiring lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e740bbce-a947-423c-af1c-21a850d1611c req-7d1561ff-d133-4c19-9a53-169e97f38c84 service nova] Acquired lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.network.neutron [req-e740bbce-a947-423c-af1c-21a850d1611c req-7d1561ff-d133-4c19-9a53-169e97f38c84 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Refreshing network info cache for port 7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:26 user nova-compute[73208]: INFO nova.compute.manager [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Terminating instance
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.compute.manager [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-5541e6c2-d02a-440d-a8fd-72d548999f04 req-28c5df26-1ec8-429d-a4b6-b5ff1493fa37 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-vif-unplugged-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5541e6c2-d02a-440d-a8fd-72d548999f04 req-28c5df26-1ec8-429d-a4b6-b5ff1493fa37 service nova] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5541e6c2-d02a-440d-a8fd-72d548999f04 req-28c5df26-1ec8-429d-a4b6-b5ff1493fa37 service nova] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5541e6c2-d02a-440d-a8fd-72d548999f04 req-28c5df26-1ec8-429d-a4b6-b5ff1493fa37 service nova] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-5541e6c2-d02a-440d-a8fd-72d548999f04 req-28c5df26-1ec8-429d-a4b6-b5ff1493fa37 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] No waiting events found dispatching network-vif-unplugged-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-5541e6c2-d02a-440d-a8fd-72d548999f04 req-28c5df26-1ec8-429d-a4b6-b5ff1493fa37 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-vif-unplugged-7d90a76c-2029-41ac-bbba-a6119c69521d for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.network.neutron [req-e740bbce-a947-423c-af1c-21a850d1611c req-7d1561ff-d133-4c19-9a53-169e97f38c84 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updated VIF entry in instance network info cache for port 7d90a76c-2029-41ac-bbba-a6119c69521d. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG nova.network.neutron [req-e740bbce-a947-423c-af1c-21a850d1611c req-7d1561ff-d133-4c19-9a53-169e97f38c84 service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updating instance_info_cache with network_info: [{"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e740bbce-a947-423c-af1c-21a850d1611c req-7d1561ff-d133-4c19-9a53-169e97f38c84 service nova] Releasing lock "refresh_cache-e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Instance destroyed successfully.
Aug 16 09:22:27 user nova-compute[73208]: DEBUG nova.objects.instance [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lazy-loading 'resources' on Instance uuid e8646f12-ea4a-4ba2-81e4-b4d9323f13ff {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2112282736',display_name='tempest-TestStampPattern-server-2112282736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2112282736',id=18,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFP34sDs4CLYmubLSC4kCMpHtWHceMAeRCdklXcRBkRvJzGIHCzM0kgKwFuU1BnHR9jMIwv0gvQmT5STpCWuKJTa9HncMQEEcyd0scFYwDrZm/j986rVnynsvKDg7Y+KA==',key_name='tempest-TestStampPattern-2113117152',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='deeb19a8593540b48b0954bad0f1a0fb',ramdisk_id='',reservation_id='r-nv5k4kab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1918763131',owner_user_name='tempest-TestStampPattern-1918763131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:18:20Z,user_data=None,user_id='5b7f7948212d4084b5599646e2486136',uuid=e8646f12-ea4a-4ba2-81e4-b4d9323f13ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converting VIF {"id": "7d90a76c-2029-41ac-bbba-a6119c69521d", "address": "fa:16:3e:a8:83:ff", "network": {"id": "cb9126df-61f9-4d8c-8f36-bed6b758a785", "bridge": "br-int", "label": "tempest-TestStampPattern-571113191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deeb19a8593540b48b0954bad0f1a0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d90a76c-20", "ovs_interfaceid": "7d90a76c-2029-41ac-bbba-a6119c69521d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:83:ff,bridge_name='br-int',has_traffic_filtering=True,id=7d90a76c-2029-41ac-bbba-a6119c69521d,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d90a76c-20') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG os_vif [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:83:ff,bridge_name='br-int',has_traffic_filtering=True,id=7d90a76c-2029-41ac-bbba-a6119c69521d,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d90a76c-20') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d90a76c-20, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:27 user nova-compute[73208]: INFO os_vif [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:83:ff,bridge_name='br-int',has_traffic_filtering=True,id=7d90a76c-2029-41ac-bbba-a6119c69521d,network=Network(cb9126df-61f9-4d8c-8f36-bed6b758a785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d90a76c-20')
Aug 16 09:22:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Deleting instance files /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff_del
Aug 16 09:22:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Deletion of /opt/stack/data/nova/instances/e8646f12-ea4a-4ba2-81e4-b4d9323f13ff_del complete
Aug 16 09:22:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:27 user nova-compute[73208]: INFO nova.compute.manager [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 16 09:22:27 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:22:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:22:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=25.38498306274414GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:28 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Took 0.60 seconds to deallocate network for instance.
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-5bd54bd7-a9da-4b8f-ad9a-9a07c7163a94 req-b5b447fc-7612-4711-b892-4b404c51b35b service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-vif-deleted-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ce7f5083-c390-4418-9e65-5abc231a12fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 449e3892-5f7f-41df-828e-75573ad2d8a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.376s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-d0c03278-9b47-440d-aba9-c0152194217a req-b5b4f20e-c8bf-4f40-938e-44ca74450d1c service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received event network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0c03278-9b47-440d-aba9-c0152194217a req-b5b4f20e-c8bf-4f40-938e-44ca74450d1c service nova] Acquiring lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0c03278-9b47-440d-aba9-c0152194217a req-b5b4f20e-c8bf-4f40-938e-44ca74450d1c service nova] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0c03278-9b47-440d-aba9-c0152194217a req-b5b4f20e-c8bf-4f40-938e-44ca74450d1c service nova] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-d0c03278-9b47-440d-aba9-c0152194217a req-b5b4f20e-c8bf-4f40-938e-44ca74450d1c service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] No waiting events found dispatching network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:22:28 user nova-compute[73208]: WARNING nova.compute.manager [req-d0c03278-9b47-440d-aba9-c0152194217a req-b5b4f20e-c8bf-4f40-938e-44ca74450d1c service nova] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Received unexpected event network-vif-plugged-7d90a76c-2029-41ac-bbba-a6119c69521d for instance with vm_state deleted and task_state None.
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:22:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:28 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Deleted allocations for instance e8646f12-ea4a-4ba2-81e4-b4d9323f13ff
Aug 16 09:22:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21d0130b-3e7b-40eb-b1fe-a31473f547c5 tempest-TestStampPattern-1918763131 tempest-TestStampPattern-1918763131-project-member] Lock "e8646f12-ea4a-4ba2-81e4-b4d9323f13ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.681s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:22:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:22:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:22:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:22:31 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:22:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Updating instance_info_cache with network_info: [{"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-058f8eb5-1d85-433a-b10c-8b3b255129c5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:22:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:36 user nova-compute[73208]: INFO nova.virt.block_device [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Booting with volume cfff5891-02cb-423e-b9dc-8f268da25f58 at /dev/vdc
Aug 16 09:22:36 user nova-compute[73208]: DEBUG os_brick.utils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[28feaf08-7341-48fc-a91a-7b89e9cbb7f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51c9304-8639-4d8e-8623-7a05efe0da90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3de8ad-e78b-42c8-a3cd-1794b1e933fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[479fbab7-c223-4081-8703-dfdb538d7944]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:22:36 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e051be-0e36-408a-a71d-c645b3cb2eb1]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG os_brick.utils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating existing volume attachment record: 2b6e17ff-0826-43d4-b423-df29b627d119 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_power_states {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:36 user nova-compute[73208]: WARNING nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid aeff110f-8cbd-480d-8654-b0daee121eb7 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid e23ec51a-a5cb-451b-91aa-f2b241d2b0cd {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 058f8eb5-1d85-433a-b10c-8b3b255129c5 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid ce7f5083-c390-4418-9e65-5abc231a12fc {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 449e3892-5f7f-41df-828e-75573ad2d8a8 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "6b259ec1-e74b-4255-aedf-685818f23c76" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "6b259ec1-e74b-4255-aedf-685818f23c76" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:37 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:22:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-32231acf-9497-4d41-aa9e-2e5e6cb3ddaa req-376a6480-f0cc-407b-8855-1570fb760ba9 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received event network-changed-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-32231acf-9497-4d41-aa9e-2e5e6cb3ddaa req-376a6480-f0cc-407b-8855-1570fb760ba9 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Refreshing instance network info cache due to event network-changed-d993aab2-6e2d-410c-9538-d9b0bbcc560d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:22:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32231acf-9497-4d41-aa9e-2e5e6cb3ddaa req-376a6480-f0cc-407b-8855-1570fb760ba9 service nova] Acquiring lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:22:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32231acf-9497-4d41-aa9e-2e5e6cb3ddaa req-376a6480-f0cc-407b-8855-1570fb760ba9 service nova] Acquired lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:22:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-32231acf-9497-4d41-aa9e-2e5e6cb3ddaa req-376a6480-f0cc-407b-8855-1570fb760ba9 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Refreshing network info cache for port d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG nova.objects.instance [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'flavor' on Instance uuid 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:22:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Ignoring supplied device name: /dev/vdb
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:41 user nova-compute[73208]: INFO nova.compute.manager [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Attaching volume 4820c7aa-bf06-4104-b53c-57b6d82adb9a to /dev/vdb
Aug 16 09:22:41 user nova-compute[73208]: DEBUG os_brick.utils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[506ab580-cb86-47e3-b14b-950b6cab6122]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dccaf9-f546-4fc5-a6dd-e9c24f6bc393]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[34faecf0-ab74-4796-bd27-3bb09e86ac0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dfcd87-7b00-43f3-bff5-a8fad24d6452]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:22:41 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e273c3-01c1-4308-a029-390370acca62]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG os_brick.utils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Updating existing volume attachment record: f6fb2035-a644-414a-a1da-ce3fee7a6832 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG nova.network.neutron [req-32231acf-9497-4d41-aa9e-2e5e6cb3ddaa req-376a6480-f0cc-407b-8855-1570fb760ba9 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Updated VIF entry in instance network info cache for port d993aab2-6e2d-410c-9538-d9b0bbcc560d. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG nova.network.neutron [req-32231acf-9497-4d41-aa9e-2e5e6cb3ddaa req-376a6480-f0cc-407b-8855-1570fb760ba9 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Updating instance_info_cache with network_info: [{"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:22:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-32231acf-9497-4d41-aa9e-2e5e6cb3ddaa req-376a6480-f0cc-407b-8855-1570fb760ba9 service nova] Releasing lock "refresh_cache-1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:42 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177747.1590886, e8646f12-ea4a-4ba2-81e4-b4d9323f13ff => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:22:42 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] VM Stopped (Lifecycle Event)
Aug 16 09:22:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e12890ed-681f-4642-a89e-cea246d1af32 None None] [instance: e8646f12-ea4a-4ba2-81e4-b4d9323f13ff] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:22:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:43 user nova-compute[73208]: INFO nova.compute.manager [None req-a25df863-8eca-4642-be0e-5da45cba138b tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Unrescuing
Aug 16 09:22:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a25df863-8eca-4642-be0e-5da45cba138b tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a25df863-8eca-4642-be0e-5da45cba138b tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquired lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a25df863-8eca-4642-be0e-5da45cba138b tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a25df863-8eca-4642-be0e-5da45cba138b tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updating instance_info_cache with network_info: [{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a25df863-8eca-4642-be0e-5da45cba138b tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Releasing lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a25df863-8eca-4642-be0e-5da45cba138b tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'flavor' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-702a3f7f-92c2-44a5-8d80-dc758f6bcb93 req-83ff8a13-6234-4892-ae64-3f918752e8be service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-702a3f7f-92c2-44a5-8d80-dc758f6bcb93 req-83ff8a13-6234-4892-ae64-3f918752e8be service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-702a3f7f-92c2-44a5-8d80-dc758f6bcb93 req-83ff8a13-6234-4892-ae64-3f918752e8be service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-702a3f7f-92c2-44a5-8d80-dc758f6bcb93 req-83ff8a13-6234-4892-ae64-3f918752e8be service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-702a3f7f-92c2-44a5-8d80-dc758f6bcb93 req-83ff8a13-6234-4892-ae64-3f918752e8be service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:22:43 user nova-compute[73208]: WARNING nova.compute.manager [req-702a3f7f-92c2-44a5-8d80-dc758f6bcb93 req-83ff8a13-6234-4892-ae64-3f918752e8be service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:22:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:44 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance destroyed successfully.
Aug 16 09:22:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:22:45 user nova-compute[73208]: WARNING nova.compute.manager [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:22:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:22:45 user nova-compute[73208]: WARNING nova.compute.manager [req-33080cb5-1c6b-49bc-bf45-55b0e999d02a req-d9cc658e-3155-4607-ae2e-ee3462d329b3 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:22:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for 6b259ec1-e74b-4255-aedf-685818f23c76 due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:22:47 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177767.863737, 6b259ec1-e74b-4255-aedf-685818f23c76 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:22:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] VM Resumed (Lifecycle Event)
Aug 16 09:22:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a25df863-8eca-4642-be0e-5da45cba138b tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:22:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:22:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:22:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 09:22:47 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177767.8684099, 6b259ec1-e74b-4255-aedf-685818f23c76 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:22:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] VM Started (Lifecycle Event)
Aug 16 09:22:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:22:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:22:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-6d977750-653d-422f-b293-ab52f68470a5 req-27f23a4a-5042-4b99-b5dc-77e9fbbf05ba service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6d977750-653d-422f-b293-ab52f68470a5 req-27f23a4a-5042-4b99-b5dc-77e9fbbf05ba service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6d977750-653d-422f-b293-ab52f68470a5 req-27f23a4a-5042-4b99-b5dc-77e9fbbf05ba service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6d977750-653d-422f-b293-ab52f68470a5 req-27f23a4a-5042-4b99-b5dc-77e9fbbf05ba service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-6d977750-653d-422f-b293-ab52f68470a5 req-27f23a4a-5042-4b99-b5dc-77e9fbbf05ba service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:22:48 user nova-compute[73208]: WARNING nova.compute.manager [req-6d977750-653d-422f-b293-ab52f68470a5 req-27f23a4a-5042-4b99-b5dc-77e9fbbf05ba service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state None.
Aug 16 09:22:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-6e774320-541e-44b5-9644-b83389abe63d req-ec92648a-8277-4b0c-94de-07ec09f1f450 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received event network-changed-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-6e774320-541e-44b5-9644-b83389abe63d req-ec92648a-8277-4b0c-94de-07ec09f1f450 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Refreshing instance network info cache due to event network-changed-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:22:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e774320-541e-44b5-9644-b83389abe63d req-ec92648a-8277-4b0c-94de-07ec09f1f450 service nova] Acquiring lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:22:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e774320-541e-44b5-9644-b83389abe63d req-ec92648a-8277-4b0c-94de-07ec09f1f450 service nova] Acquired lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:22:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-6e774320-541e-44b5-9644-b83389abe63d req-ec92648a-8277-4b0c-94de-07ec09f1f450 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Refreshing network info cache for port 52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:22:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-6e774320-541e-44b5-9644-b83389abe63d req-ec92648a-8277-4b0c-94de-07ec09f1f450 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Updated VIF entry in instance network info cache for port 52bb4dbc-e48d-42dc-a0c7-facb91fd42bd. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:22:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-6e774320-541e-44b5-9644-b83389abe63d req-ec92648a-8277-4b0c-94de-07ec09f1f450 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Updating instance_info_cache with network_info: [{"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:22:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e774320-541e-44b5-9644-b83389abe63d req-ec92648a-8277-4b0c-94de-07ec09f1f450 service nova] Releasing lock "refresh_cache-ce7f5083-c390-4418-9e65-5abc231a12fc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:22:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Creating image(s)
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Ensure instance console log exists: /opt/stack/data/nova/instances/449e3892-5f7f-41df-828e-75573ad2d8a8/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Start _get_guest_xml network_info=[{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'c5888c25-47c2-4f51-ad09-140ac80654d8', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGhkbFns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '449e3892-5f7f-41df-828e-75573ad2d8a8', 'attached_at': '', 'detached_at': '', 'volume_id': '0b7b75c9-8778-4a6d-8067-0f86f0183c84', 'serial': '0b7b75c9-8778-4a6d-8067-0f86f0183c84'}, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '658eafd6-79cb-475c-8545-9d5c1c1ad430', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erEZcbmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '449e3892-5f7f-41df-828e-75573ad2d8a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcd02a00-6787-485e-b93e-9c54c146b8be', 'serial': 'fcd02a00-6787-485e-b93e-9c54c146b8be'}, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '2b6e17ff-0826-43d4-b423-df29b627d119', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWMthkgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '449e3892-5f7f-41df-828e-75573ad2d8a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfff5891-02cb-423e-b9dc-8f268da25f58', 'serial': 'cfff5891-02cb-423e-b9dc-8f268da25f58'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:22:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:22:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGhkbFns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:22:50 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:22:50 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:22:50 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc514e-2902-465c-b739-575a12626fee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:22:50 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac49668-a536-415f-a72f-16c164bf2fe9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84] added
Aug 16 09:22:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9b5b4e-a2f9-4cc4-9490-a741ff908c8f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac16fbe-45e8-4c2a-8396-6b24b7ad25c9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGhkbFns {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGhkbFns" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a7eae-1db6-48b4-94c2-373bbce39fcd]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iGhkbFns'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb3f86-7176-49d0-ae6c-34c795e551f6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[54044835-e0b4-4290-96f4-37b90c62ccab]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3e1d6f-1aee-4d34-b93b-1fa2dbdf25c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84, portal: 172.16.0.220,3260]
Aug 16 09:22:50 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84, portal: 172.16.0.220,3260] successful.
Aug 16 09:22:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8349a31b-98f6-42ba-9766-c69451313d3f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b729e3cc-df6c-478f-b2bf-605bccd9aae3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d067290-0a9c-4aad-b7a2-609cc1afd424]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:22:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGhkbFns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23766656330363531', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766656330363531', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erEZcbmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:22:51 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:22:51 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:22:51 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[31606936-8f4b-4fc2-aaac-80ec10501ec6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:22:51 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3647a739-65df-40cb-9b20-b06f7e23985f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be] added
Aug 16 09:22:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae0324-5683-486a-8f6e-952a32891162]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c7f1a1-2b94-4c87-b6e5-8ce79a7b3ff4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v erEZcbmz {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v erEZcbmz" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1950634e-17a8-4701-a9f6-b192570fd749]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'erEZcbmz'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e8d51-66c6-4b53-ac7e-ed8ab10b4359]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec911f-8844-4259-9792-72a89f8c4f28]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c76b59-5c9c-4874-8cab-dd23a09ca0ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be, portal: 172.16.0.220,3260]
Aug 16 09:22:51 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be, portal: 172.16.0.220,3260] successful.
Aug 16 09:22:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eacbf04-ec4a-4416-9d74-2824fb190202]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf9423-244b-4cbe-a401-6df502903642]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:51 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62d2e55-8379-423d-ad0c-cd85c1b58259]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:22:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erEZcbmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmuASGJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:22:52 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23935633166623536', 'path': '/dev/sde'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935633166623536', 'path': '/dev/sde'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.388s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:22:52 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:22:52 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f8856d-e669-4d71-9b06-24caca397d94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:22:52 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWMthkgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:22:52 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[93107b74-c07a-42b5-b215-8c405d0f9724]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a] added
Aug 16 09:22:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid ce7f5083-c390-4418-9e65-5abc231a12fc {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14e4096-dd11-4ba3-8bf5-4b31da7242f9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[96786bbd-b06c-4a5f-8331-d4a7e2a0e885]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZmuASGJY {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZmuASGJY" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6143ed37-c0c2-460e-8b6c-1b616bd0e045]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZmuASGJY'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a759e16-09fe-4919-88a7-b1f32695163c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5caf19-2c29-44f4-8b49-0906d1eba43f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9757fe7a-c56d-455c-988d-ae77612448ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a, portal: 172.16.0.220,3260]
Aug 16 09:22:53 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a, portal: 172.16.0.220,3260] successful.
Aug 16 09:22:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:53 user nova-compute[73208]: INFO nova.compute.manager [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Attaching volume 69caafdb-556b-4c42-bd43-9965ca35ccce to /dev/vdb
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03a13bc-bc87-420c-b4f7-be1035807366]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e78cdbe-18a3-4e99-b875-270b845ca434]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:22:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:53 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:22:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.utils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b8d56f-9deb-4880-9520-f922e9090eef]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54e785e-2634-4f05-8c21-650370356c47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4c2ada-ac96-4471-ae39-a5b2663633e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[14092e2b-f25e-4797-96f9-4ab9999b5591]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29e92c6-9b43-4403-8943-beb8e13151cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:22:53 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:22:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[71777606-52c0-4d55-8cdf-f372d35bb5b1]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG os_brick.utils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:22:53 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Updating existing volume attachment record: 81a3182a-5d5c-4efe-b2bd-c3074513634e {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmuASGJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] <== connect_volume: return (1746ms) {'type': 'block', 'scsi_wwn': '26336663230323930', 'path': '/dev/sdf'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336663230323930', 'path': '/dev/sdf'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.328s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:22:54 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:22:54 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG nova.objects.instance [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'flavor' on Instance uuid 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[42521ddb-28d5-433e-ad42-7523a941525f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:22:54 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:22:54 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:22:54 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:22:54 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:22:54 user nova-compute[73208]:   <serial>4820c7aa-bf06-4104-b53c-57b6d82adb9a</serial>
Aug 16 09:22:54 user nova-compute[73208]: </disk>
Aug 16 09:22:54 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1000d50-d06a-42ae-978b-526ec31628f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58] added
Aug 16 09:22:54 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3044afc8-a0f7-4551-9e5b-06f205547e08]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59eee76-155e-49c1-b539-efbba362dd5b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dWMthkgN {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dWMthkgN" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e72c1-fe4b-4bc0-a945-d81996e1d745]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dWMthkgN'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c75f841-bfb2-4436-aa6c-0a14895ecb33]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2af241-bef5-481d-9556-ffc43b7257ca]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:22:54 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:22:54 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc57e36-05cd-46c1-95ed-391bcf38f89d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58, portal: 172.16.0.220,3260]
Aug 16 09:22:54 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58, portal: 172.16.0.220,3260] successful.
Aug 16 09:22:54 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bfc18c-89cc-424b-82aa-8333562326c7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa85a58d-b412-42e1-9ee1-c912d04bf7f9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:22:54 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:22:54 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb139af5-d985-4f63-9725-a32c01dd798e]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No VIF found with MAC fa:16:3e:c3:a8:2a, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:22:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-9f3df69a-957b-40fa-8d32-8fef150d2f4f tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.534s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWMthkgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== connect_volume: return (2663ms) {'type': 'block', 'scsi_wwn': '23665316162363938', 'path': '/dev/sdg'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665316162363938', 'path': '/dev/sdg'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:57:32,bridge_name='br-int',has_traffic_filtering=True,id=52a7ad9a-8d25-4e56-8341-09d8e5d63f97,network=Network(40209d30-c9fe-431b-9f3a-75c2a4320835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a7ad9a-8d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a0:b5,bridge_name='br-int',has_traffic_filtering=True,id=da74aba8-33f2-4275-aba9-e6a9e5c3cee2,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda74aba8-33') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:e7,bridge_name='br-int',has_traffic_filtering=True,id=a11751ed-e5e6-4393-b9d0-7e51ff91c2b3,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa11751ed-e5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:12:67,bridge_name='br-int',has_traffic_filtering=True,id=43bd38d9-43ea-4cbe-a19c-7c223489ff4f,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bd38d9-43') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:c6,bridge_name='br-int',has_traffic_filtering=True,id=1de5138b-21d7-429a-ab10-056116c3d4dc,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de5138b-21') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c0d2f58-470c-44d2-8162-2a75697a5200,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0d2f58-47') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:1c,bridge_name='br-int',has_traffic_filtering=True,id=929e2681-835d-416b-9c55-3afe6319bdfb,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap929e2681-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.objects.instance [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lazy-loading 'pci_devices' on Instance uuid 449e3892-5f7f-41df-828e-75573ad2d8a8 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:22:55 user nova-compute[73208]:   <uuid>449e3892-5f7f-41df-828e-75573ad2d8a8</uuid>
Aug 16 09:22:55 user nova-compute[73208]:   <name>instance-0000001e</name>
Aug 16 09:22:55 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:22:55 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:22:55 user nova-compute[73208]:   <metadata>
Aug 16 09:22:55 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:22:55 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:22:55 user nova-compute[73208]:       <nova:name>tempest-device-tagging-server-850024993</nova:name>
Aug 16 09:22:55 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:22:50</nova:creationTime>
Aug 16 09:22:55 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:22:55 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:22:55 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:22:55 user nova-compute[73208]:       <nova:owner>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:user uuid="974df5dc0b2a47e29d9471875a21b7d0">tempest-TaggedBootDevicesTest_v242-502411029-project-member</nova:user>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:project uuid="0fc1ea26bbdd41828ba691969efeb5a7">tempest-TaggedBootDevicesTest_v242-502411029</nova:project>
Aug 16 09:22:55 user nova-compute[73208]:       </nova:owner>
Aug 16 09:22:55 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:22:55 user nova-compute[73208]:       <nova:ports>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:port uuid="52a7ad9a-8d25-4e56-8341-09d8e5d63f97">
Aug 16 09:22:55 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 09:22:55 user nova-compute[73208]:         </nova:port>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:port uuid="da74aba8-33f2-4275-aba9-e6a9e5c3cee2">
Aug 16 09:22:55 user nova-compute[73208]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Aug 16 09:22:55 user nova-compute[73208]:         </nova:port>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:port uuid="a11751ed-e5e6-4393-b9d0-7e51ff91c2b3">
Aug 16 09:22:55 user nova-compute[73208]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Aug 16 09:22:55 user nova-compute[73208]:         </nova:port>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:port uuid="43bd38d9-43ea-4cbe-a19c-7c223489ff4f">
Aug 16 09:22:55 user nova-compute[73208]:           <nova:ip type="fixed" address="10.1.1.50" ipVersion="4"/>
Aug 16 09:22:55 user nova-compute[73208]:         </nova:port>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:port uuid="1de5138b-21d7-429a-ab10-056116c3d4dc">
Aug 16 09:22:55 user nova-compute[73208]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Aug 16 09:22:55 user nova-compute[73208]:         </nova:port>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:port uuid="7c0d2f58-470c-44d2-8162-2a75697a5200">
Aug 16 09:22:55 user nova-compute[73208]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 09:22:55 user nova-compute[73208]:         </nova:port>
Aug 16 09:22:55 user nova-compute[73208]:         <nova:port uuid="929e2681-835d-416b-9c55-3afe6319bdfb">
Aug 16 09:22:55 user nova-compute[73208]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 09:22:55 user nova-compute[73208]:         </nova:port>
Aug 16 09:22:55 user nova-compute[73208]:       </nova:ports>
Aug 16 09:22:55 user nova-compute[73208]:     </nova:instance>
Aug 16 09:22:55 user nova-compute[73208]:   </metadata>
Aug 16 09:22:55 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:22:55 user nova-compute[73208]:     <system>
Aug 16 09:22:55 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:22:55 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:22:55 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:22:55 user nova-compute[73208]:       <entry name="serial">449e3892-5f7f-41df-828e-75573ad2d8a8</entry>
Aug 16 09:22:55 user nova-compute[73208]:       <entry name="uuid">449e3892-5f7f-41df-828e-75573ad2d8a8</entry>
Aug 16 09:22:55 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:22:55 user nova-compute[73208]:     </system>
Aug 16 09:22:55 user nova-compute[73208]:   </sysinfo>
Aug 16 09:22:55 user nova-compute[73208]:   <os>
Aug 16 09:22:55 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:22:55 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:22:55 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:22:55 user nova-compute[73208]:   </os>
Aug 16 09:22:55 user nova-compute[73208]:   <features>
Aug 16 09:22:55 user nova-compute[73208]:     <acpi/>
Aug 16 09:22:55 user nova-compute[73208]:     <apic/>
Aug 16 09:22:55 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:22:55 user nova-compute[73208]:   </features>
Aug 16 09:22:55 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:22:55 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:22:55 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:22:55 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:22:55 user nova-compute[73208]:   </clock>
Aug 16 09:22:55 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:22:55 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:22:55 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:22:55 user nova-compute[73208]:   </cpu>
Aug 16 09:22:55 user nova-compute[73208]:   <devices>
Aug 16 09:22:55 user nova-compute[73208]:     <disk type="file" device="cdrom">
Aug 16 09:22:55 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 09:22:55 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/449e3892-5f7f-41df-828e-75573ad2d8a8/disk.config"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="hda" bus="ide"/>
Aug 16 09:22:55 user nova-compute[73208]:     </disk>
Aug 16 09:22:55 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:22:55 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:22:55 user nova-compute[73208]:       <source dev="/dev/sdd"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <serial>0b7b75c9-8778-4a6d-8067-0f86f0183c84</serial>
Aug 16 09:22:55 user nova-compute[73208]:     </disk>
Aug 16 09:22:55 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:22:55 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:22:55 user nova-compute[73208]:       <source dev="/dev/sde"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <serial>fcd02a00-6787-485e-b93e-9c54c146b8be</serial>
Aug 16 09:22:55 user nova-compute[73208]:     </disk>
Aug 16 09:22:55 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:22:55 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:22:55 user nova-compute[73208]:       <source dev="/dev/sdg"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="vdc" bus="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <serial>cfff5891-02cb-423e-b9dc-8f268da25f58</serial>
Aug 16 09:22:55 user nova-compute[73208]:     </disk>
Aug 16 09:22:55 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:22:55 user nova-compute[73208]:       <mac address="fa:16:3e:4f:57:32"/>
Aug 16 09:22:55 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="tap52a7ad9a-8d"/>
Aug 16 09:22:55 user nova-compute[73208]:     </interface>
Aug 16 09:22:55 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:22:55 user nova-compute[73208]:       <mac address="fa:16:3e:03:a0:b5"/>
Aug 16 09:22:55 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="tapda74aba8-33"/>
Aug 16 09:22:55 user nova-compute[73208]:     </interface>
Aug 16 09:22:55 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:22:55 user nova-compute[73208]:       <mac address="fa:16:3e:da:67:e7"/>
Aug 16 09:22:55 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="tapa11751ed-e5"/>
Aug 16 09:22:55 user nova-compute[73208]:     </interface>
Aug 16 09:22:55 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:22:55 user nova-compute[73208]:       <mac address="fa:16:3e:a4:12:67"/>
Aug 16 09:22:55 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="tap43bd38d9-43"/>
Aug 16 09:22:55 user nova-compute[73208]:     </interface>
Aug 16 09:22:55 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:22:55 user nova-compute[73208]:       <mac address="fa:16:3e:98:0b:c6"/>
Aug 16 09:22:55 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="tap1de5138b-21"/>
Aug 16 09:22:55 user nova-compute[73208]:     </interface>
Aug 16 09:22:55 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:22:55 user nova-compute[73208]:       <mac address="fa:16:3e:1b:29:ec"/>
Aug 16 09:22:55 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="tap7c0d2f58-47"/>
Aug 16 09:22:55 user nova-compute[73208]:     </interface>
Aug 16 09:22:55 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:22:55 user nova-compute[73208]:       <mac address="fa:16:3e:23:4b:1c"/>
Aug 16 09:22:55 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:22:55 user nova-compute[73208]:       <target dev="tap929e2681-83"/>
Aug 16 09:22:55 user nova-compute[73208]:     </interface>
Aug 16 09:22:55 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:22:55 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/449e3892-5f7f-41df-828e-75573ad2d8a8/console.log" append="off"/>
Aug 16 09:22:55 user nova-compute[73208]:     </serial>
Aug 16 09:22:55 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:22:55 user nova-compute[73208]:     <video>
Aug 16 09:22:55 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:22:55 user nova-compute[73208]:     </video>
Aug 16 09:22:55 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:22:55 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:22:55 user nova-compute[73208]:     </rng>
Aug 16 09:22:55 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:22:55 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:22:55 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:22:55 user nova-compute[73208]:     </memballoon>
Aug 16 09:22:55 user nova-compute[73208]:   </devices>
Aug 16 09:22:55 user nova-compute[73208]: </domain>
Aug 16 09:22:55 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:57:32,bridge_name='br-int',has_traffic_filtering=True,id=52a7ad9a-8d25-4e56-8341-09d8e5d63f97,network=Network(40209d30-c9fe-431b-9f3a-75c2a4320835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a7ad9a-8d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:57:32,bridge_name='br-int',has_traffic_filtering=True,id=52a7ad9a-8d25-4e56-8341-09d8e5d63f97,network=Network(40209d30-c9fe-431b-9f3a-75c2a4320835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a7ad9a-8d') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52a7ad9a-8d, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52a7ad9a-8d, col_values=(('external_ids', {'iface-id': '52a7ad9a-8d25-4e56-8341-09d8e5d63f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:57:32', 'vm-uuid': '449e3892-5f7f-41df-828e-75573ad2d8a8'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: INFO os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:57:32,bridge_name='br-int',has_traffic_filtering=True,id=52a7ad9a-8d25-4e56-8341-09d8e5d63f97,network=Network(40209d30-c9fe-431b-9f3a-75c2a4320835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a7ad9a-8d')
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a0:b5,bridge_name='br-int',has_traffic_filtering=True,id=da74aba8-33f2-4275-aba9-e6a9e5c3cee2,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda74aba8-33') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a0:b5,bridge_name='br-int',has_traffic_filtering=True,id=da74aba8-33f2-4275-aba9-e6a9e5c3cee2,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda74aba8-33') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda74aba8-33, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda74aba8-33, col_values=(('external_ids', {'iface-id': 'da74aba8-33f2-4275-aba9-e6a9e5c3cee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:a0:b5', 'vm-uuid': '449e3892-5f7f-41df-828e-75573ad2d8a8'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: INFO os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a0:b5,bridge_name='br-int',has_traffic_filtering=True,id=da74aba8-33f2-4275-aba9-e6a9e5c3cee2,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda74aba8-33')
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:e7,bridge_name='br-int',has_traffic_filtering=True,id=a11751ed-e5e6-4393-b9d0-7e51ff91c2b3,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa11751ed-e5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:e7,bridge_name='br-int',has_traffic_filtering=True,id=a11751ed-e5e6-4393-b9d0-7e51ff91c2b3,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa11751ed-e5') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa11751ed-e5, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa11751ed-e5, col_values=(('external_ids', {'iface-id': 'a11751ed-e5e6-4393-b9d0-7e51ff91c2b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:67:e7', 'vm-uuid': '449e3892-5f7f-41df-828e-75573ad2d8a8'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: INFO os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:e7,bridge_name='br-int',has_traffic_filtering=True,id=a11751ed-e5e6-4393-b9d0-7e51ff91c2b3,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa11751ed-e5')
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:12:67,bridge_name='br-int',has_traffic_filtering=True,id=43bd38d9-43ea-4cbe-a19c-7c223489ff4f,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bd38d9-43') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:12:67,bridge_name='br-int',has_traffic_filtering=True,id=43bd38d9-43ea-4cbe-a19c-7c223489ff4f,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bd38d9-43') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43bd38d9-43, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43bd38d9-43, col_values=(('external_ids', {'iface-id': '43bd38d9-43ea-4cbe-a19c-7c223489ff4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:12:67', 'vm-uuid': '449e3892-5f7f-41df-828e-75573ad2d8a8'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: INFO os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:12:67,bridge_name='br-int',has_traffic_filtering=True,id=43bd38d9-43ea-4cbe-a19c-7c223489ff4f,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bd38d9-43')
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:c6,bridge_name='br-int',has_traffic_filtering=True,id=1de5138b-21d7-429a-ab10-056116c3d4dc,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de5138b-21') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:c6,bridge_name='br-int',has_traffic_filtering=True,id=1de5138b-21d7-429a-ab10-056116c3d4dc,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de5138b-21') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1de5138b-21, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1de5138b-21, col_values=(('external_ids', {'iface-id': '1de5138b-21d7-429a-ab10-056116c3d4dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:0b:c6', 'vm-uuid': '449e3892-5f7f-41df-828e-75573ad2d8a8'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: INFO os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:c6,bridge_name='br-int',has_traffic_filtering=True,id=1de5138b-21d7-429a-ab10-056116c3d4dc,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de5138b-21')
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c0d2f58-470c-44d2-8162-2a75697a5200,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0d2f58-47') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c0d2f58-470c-44d2-8162-2a75697a5200,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0d2f58-47') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c0d2f58-47, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c0d2f58-47, col_values=(('external_ids', {'iface-id': '7c0d2f58-470c-44d2-8162-2a75697a5200', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:29:ec', 'vm-uuid': '449e3892-5f7f-41df-828e-75573ad2d8a8'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: INFO os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c0d2f58-470c-44d2-8162-2a75697a5200,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0d2f58-47')
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:1c,bridge_name='br-int',has_traffic_filtering=True,id=929e2681-835d-416b-9c55-3afe6319bdfb,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap929e2681-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:1c,bridge_name='br-int',has_traffic_filtering=True,id=929e2681-835d-416b-9c55-3afe6319bdfb,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap929e2681-83') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap929e2681-83, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap929e2681-83, col_values=(('external_ids', {'iface-id': '929e2681-835d-416b-9c55-3afe6319bdfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:4b:1c', 'vm-uuid': '449e3892-5f7f-41df-828e-75573ad2d8a8'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:22:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:55 user nova-compute[73208]: INFO os_vif [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:1c,bridge_name='br-int',has_traffic_filtering=True,id=929e2681-835d-416b-9c55-3afe6319bdfb,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap929e2681-83')
Aug 16 09:22:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] No BDM found with device name hda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:22:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:22:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] No VIF found with MAC fa:16:3e:4f:57:32, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:22:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] No VIF found with MAC fa:16:3e:98:0b:c6, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:22:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Using config drive
Aug 16 09:22:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Creating config drive at /opt/stack/data/nova/instances/449e3892-5f7f-41df-828e-75573ad2d8a8/disk.config
Aug 16 09:22:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/449e3892-5f7f-41df-828e-75573ad2d8a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_x3rt_0_ {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:22:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/449e3892-5f7f-41df-828e-75573ad2d8a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_x3rt_0_" returned: 0 in 0.084s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:22:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-977e6349-1971-481f-94cc-83bb43cf4554 req-940f6084-41ca-48bd-bc85-2f3fb81f2508 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-977e6349-1971-481f-94cc-83bb43cf4554 req-940f6084-41ca-48bd-bc85-2f3fb81f2508 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-977e6349-1971-481f-94cc-83bb43cf4554 req-940f6084-41ca-48bd-bc85-2f3fb81f2508 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-977e6349-1971-481f-94cc-83bb43cf4554 req-940f6084-41ca-48bd-bc85-2f3fb81f2508 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-977e6349-1971-481f-94cc-83bb43cf4554 req-940f6084-41ca-48bd-bc85-2f3fb81f2508 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:22:58 user nova-compute[73208]: WARNING nova.compute.manager [req-977e6349-1971-481f-94cc-83bb43cf4554 req-940f6084-41ca-48bd-bc85-2f3fb81f2508 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 for instance with vm_state building and task_state spawning.
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-9d30e83d-7add-47c0-877a-53cf9c37decc req-cefee0a6-64a9-4c1d-9907-c41e7c82065c service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9d30e83d-7add-47c0-877a-53cf9c37decc req-cefee0a6-64a9-4c1d-9907-c41e7c82065c service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9d30e83d-7add-47c0-877a-53cf9c37decc req-cefee0a6-64a9-4c1d-9907-c41e7c82065c service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9d30e83d-7add-47c0-877a-53cf9c37decc req-cefee0a6-64a9-4c1d-9907-c41e7c82065c service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-9d30e83d-7add-47c0-877a-53cf9c37decc req-cefee0a6-64a9-4c1d-9907-c41e7c82065c service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:22:58 user nova-compute[73208]: WARNING nova.compute.manager [req-9d30e83d-7add-47c0-877a-53cf9c37decc req-cefee0a6-64a9-4c1d-9907-c41e7c82065c service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 for instance with vm_state building and task_state spawning.
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:22:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-8d77fb85-b808-4c98-ae5e-3c9fa6025676 req-80048255-49b0-4ca8-bd17-7d1bd1538a0a service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8d77fb85-b808-4c98-ae5e-3c9fa6025676 req-80048255-49b0-4ca8-bd17-7d1bd1538a0a service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8d77fb85-b808-4c98-ae5e-3c9fa6025676 req-80048255-49b0-4ca8-bd17-7d1bd1538a0a service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8d77fb85-b808-4c98-ae5e-3c9fa6025676 req-80048255-49b0-4ca8-bd17-7d1bd1538a0a service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-8d77fb85-b808-4c98-ae5e-3c9fa6025676 req-80048255-49b0-4ca8-bd17-7d1bd1538a0a service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-8d77fb85-b808-4c98-ae5e-3c9fa6025676 req-80048255-49b0-4ca8-bd17-7d1bd1538a0a service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-dd3d06a5-b911-4e1e-b9d3-79941b5a1792 req-878a00b1-1066-461d-8337-5ba140ed7d38 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:00 user nova-compute[73208]: WARNING nova.compute.manager [req-b250dbd4-4e84-43e0-8601-ca53e168206f req-a6641dce-cb4c-403d-80e8-d186706b8b05 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb for instance with vm_state building and task_state spawning.
Aug 16 09:23:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-dac19282-ac39-4e14-b679-c0eddd053dbe req-7dbe44a9-f5bb-4b3f-be5e-136991a0a35b service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dac19282-ac39-4e14-b679-c0eddd053dbe req-7dbe44a9-f5bb-4b3f-be5e-136991a0a35b service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dac19282-ac39-4e14-b679-c0eddd053dbe req-7dbe44a9-f5bb-4b3f-be5e-136991a0a35b service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dac19282-ac39-4e14-b679-c0eddd053dbe req-7dbe44a9-f5bb-4b3f-be5e-136991a0a35b service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-dac19282-ac39-4e14-b679-c0eddd053dbe req-7dbe44a9-f5bb-4b3f-be5e-136991a0a35b service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:02 user nova-compute[73208]: WARNING nova.compute.manager [req-dac19282-ac39-4e14-b679-c0eddd053dbe req-7dbe44a9-f5bb-4b3f-be5e-136991a0a35b service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 for instance with vm_state building and task_state spawning.
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177782.3271534, 449e3892-5f7f-41df-828e-75573ad2d8a8 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:23:02 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] VM Resumed (Lifecycle Event)
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:23:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance spawned successfully.
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:02 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177782.3292518, 449e3892-5f7f-41df-828e-75573ad2d8a8 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:23:02 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] VM Started (Lifecycle Event)
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:23:02 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:23:02 user nova-compute[73208]: INFO nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Took 12.39 seconds to spawn the instance on the hypervisor.
Aug 16 09:23:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:02 user nova-compute[73208]: INFO nova.compute.manager [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Took 74.52 seconds to build instance.
Aug 16 09:23:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-17762277-170e-468b-afb3-f73888a5db9b tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 74.620s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 26.176s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:02 user nova-compute[73208]: INFO nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 16 09:23:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATzIkLwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:23:07 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:23:07 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:23:07 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc253e80-8bf3-47a3-b7da-28d27de65f93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:23:07 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4dd479-1e64-468f-ac43-aa443e6b8ef1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce] added
Aug 16 09:23:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ba83e-db49-47b5-b849-df036ea50c34]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1bcf6c-2ad6-4a5d-ab6f-9098f970ee43]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ATzIkLwl {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ATzIkLwl" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c9ada1-f6af-4fef-8b12-d6d7815dd2ed]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ATzIkLwl'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b619d3-09f1-498a-b253-ca06e3f29dab]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f6975-7bd8-4302-922f-73b208984180]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bccfad-f740-4d30-8d6f-eee6b2ed580c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce, portal: 172.16.0.220,3260]
Aug 16 09:23:07 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce, portal: 172.16.0.220,3260] successful.
Aug 16 09:23:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ef1bac-d07a-483e-8767-1bf7473aa37d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81f32c3-a59a-4ccd-bb16-b36b32b469c1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:23:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:23:07 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:23:07 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] HCTL ('39', '-', '-', 0) found on session 36 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abf0061-f38a-4f94-8fa8-c7a13200cf31]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:23:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATzIkLwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:23:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:23:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26661636133666136', 'path': '/dev/sdh'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:23:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661636133666136', 'path': '/dev/sdh'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:23:08 user nova-compute[73208]: DEBUG nova.objects.instance [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid ce7f5083-c390-4418-9e65-5abc231a12fc {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:23:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:23:08 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:23:08 user nova-compute[73208]:   <source dev="/dev/sdh"/>
Aug 16 09:23:08 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:23:08 user nova-compute[73208]:   <serial>69caafdb-556b-4c42-bd43-9965ca35ccce</serial>
Aug 16 09:23:08 user nova-compute[73208]: </disk>
Aug 16 09:23:08 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:23:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:23:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:23:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No VIF found with MAC fa:16:3e:ff:22:dc, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:23:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56898fb8-ed53-4676-987f-d8567fa6c665 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.040s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:23:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:23:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:23:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:23:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:23:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "85c48f53-33ae-43eb-b5d2-6d44700bed41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:23:13 user nova-compute[73208]: INFO nova.compute.claims [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Claim successful on node user
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.network.neutron [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:23:13 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:23:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG nova.policy [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18737770cdee43d6a782ebbbd311e8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12301729e76a42afa0c8923d3d428cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:23:14 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Creating image(s)
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "/opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "/opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "/opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.236s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.202s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk 1073741824" returned: 0 in 0.060s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG nova.network.neutron [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Successfully created port: e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:14 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Cannot resize image /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG nova.objects.instance [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'migration_context' on Instance uuid 85c48f53-33ae-43eb-b5d2-6d44700bed41 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Ensure instance console log exists: /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Successfully updated port: e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquired lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-362b4eb3-54f7-49d6-b901-d5c1958db050 req-0af393ad-b614-4842-9689-bb5d3a008b66 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received event network-changed-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-362b4eb3-54f7-49d6-b901-d5c1958db050 req-0af393ad-b614-4842-9689-bb5d3a008b66 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Refreshing instance network info cache due to event network-changed-e7910409-c383-428b-8942-02292d27e33e. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-362b4eb3-54f7-49d6-b901-d5c1958db050 req-0af393ad-b614-4842-9689-bb5d3a008b66 service nova] Acquiring lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:23:15 user nova-compute[73208]: DEBUG nova.network.neutron [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.network.neutron [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Updating instance_info_cache with network_info: [{"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Releasing lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Instance network_info: |[{"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-362b4eb3-54f7-49d6-b901-d5c1958db050 req-0af393ad-b614-4842-9689-bb5d3a008b66 service nova] Acquired lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-362b4eb3-54f7-49d6-b901-d5c1958db050 req-0af393ad-b614-4842-9689-bb5d3a008b66 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Refreshing network info cache for port e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Start _get_guest_xml network_info=[{"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:23:16 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:23:16 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-803217606',display_name='tempest-AttachVolumeNegativeTest-server-803217606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-803217606',id=31,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd3NFYn9DMAb7fYl7q0ARwZw5pCY+sl2pOvIzdOO4np+14wHW4loxBuWmOkGOqOsAsRZ2HIZpJsLaal93dgX7ithFoJgVWpLTeyQA/jQG7z4QrNLahPgfHuAoWddAk8gA==',key_name='tempest-keypair-1426766664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-1fwb7qp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=85c48f53-33ae-43eb-b5d2-6d44700bed41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:c3,bridge_name='br-int',has_traffic_filtering=True,id=e7910409-c383-428b-8942-02292d27e33e,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7910409-c3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.objects.instance [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'pci_devices' on Instance uuid 85c48f53-33ae-43eb-b5d2-6d44700bed41 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:23:16 user nova-compute[73208]:   <uuid>85c48f53-33ae-43eb-b5d2-6d44700bed41</uuid>
Aug 16 09:23:16 user nova-compute[73208]:   <name>instance-0000001f</name>
Aug 16 09:23:16 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:23:16 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:23:16 user nova-compute[73208]:   <metadata>
Aug 16 09:23:16 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:23:16 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:23:16 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeNegativeTest-server-803217606</nova:name>
Aug 16 09:23:16 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:23:16</nova:creationTime>
Aug 16 09:23:16 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:23:16 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:23:16 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:23:16 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:23:16 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:23:16 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:23:16 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:23:16 user nova-compute[73208]:       <nova:owner>
Aug 16 09:23:16 user nova-compute[73208]:         <nova:user uuid="18737770cdee43d6a782ebbbd311e8fc">tempest-AttachVolumeNegativeTest-657236303-project-member</nova:user>
Aug 16 09:23:16 user nova-compute[73208]:         <nova:project uuid="12301729e76a42afa0c8923d3d428cac">tempest-AttachVolumeNegativeTest-657236303</nova:project>
Aug 16 09:23:16 user nova-compute[73208]:       </nova:owner>
Aug 16 09:23:16 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:23:16 user nova-compute[73208]:       <nova:ports>
Aug 16 09:23:16 user nova-compute[73208]:         <nova:port uuid="e7910409-c383-428b-8942-02292d27e33e">
Aug 16 09:23:16 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:23:16 user nova-compute[73208]:         </nova:port>
Aug 16 09:23:16 user nova-compute[73208]:       </nova:ports>
Aug 16 09:23:16 user nova-compute[73208]:     </nova:instance>
Aug 16 09:23:16 user nova-compute[73208]:   </metadata>
Aug 16 09:23:16 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:23:16 user nova-compute[73208]:     <system>
Aug 16 09:23:16 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:23:16 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:23:16 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:23:16 user nova-compute[73208]:       <entry name="serial">85c48f53-33ae-43eb-b5d2-6d44700bed41</entry>
Aug 16 09:23:16 user nova-compute[73208]:       <entry name="uuid">85c48f53-33ae-43eb-b5d2-6d44700bed41</entry>
Aug 16 09:23:16 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:23:16 user nova-compute[73208]:     </system>
Aug 16 09:23:16 user nova-compute[73208]:   </sysinfo>
Aug 16 09:23:16 user nova-compute[73208]:   <os>
Aug 16 09:23:16 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:23:16 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:23:16 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:23:16 user nova-compute[73208]:   </os>
Aug 16 09:23:16 user nova-compute[73208]:   <features>
Aug 16 09:23:16 user nova-compute[73208]:     <acpi/>
Aug 16 09:23:16 user nova-compute[73208]:     <apic/>
Aug 16 09:23:16 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:23:16 user nova-compute[73208]:   </features>
Aug 16 09:23:16 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:23:16 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:23:16 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:23:16 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:23:16 user nova-compute[73208]:   </clock>
Aug 16 09:23:16 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:23:16 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:23:16 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:23:16 user nova-compute[73208]:   </cpu>
Aug 16 09:23:16 user nova-compute[73208]:   <devices>
Aug 16 09:23:16 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:23:16 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:23:16 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk"/>
Aug 16 09:23:16 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:23:16 user nova-compute[73208]:     </disk>
Aug 16 09:23:16 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:23:16 user nova-compute[73208]:       <mac address="fa:16:3e:b6:ef:c3"/>
Aug 16 09:23:16 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:23:16 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:23:16 user nova-compute[73208]:       <target dev="tape7910409-c3"/>
Aug 16 09:23:16 user nova-compute[73208]:     </interface>
Aug 16 09:23:16 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:23:16 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/console.log" append="off"/>
Aug 16 09:23:16 user nova-compute[73208]:     </serial>
Aug 16 09:23:16 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:23:16 user nova-compute[73208]:     <video>
Aug 16 09:23:16 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:23:16 user nova-compute[73208]:     </video>
Aug 16 09:23:16 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:23:16 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:23:16 user nova-compute[73208]:     </rng>
Aug 16 09:23:16 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:23:16 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:23:16 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:23:16 user nova-compute[73208]:     </memballoon>
Aug 16 09:23:16 user nova-compute[73208]:   </devices>
Aug 16 09:23:16 user nova-compute[73208]: </domain>
Aug 16 09:23:16 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-803217606',display_name='tempest-AttachVolumeNegativeTest-server-803217606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-803217606',id=31,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd3NFYn9DMAb7fYl7q0ARwZw5pCY+sl2pOvIzdOO4np+14wHW4loxBuWmOkGOqOsAsRZ2HIZpJsLaal93dgX7ithFoJgVWpLTeyQA/jQG7z4QrNLahPgfHuAoWddAk8gA==',key_name='tempest-keypair-1426766664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-1fwb7qp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=85c48f53-33ae-43eb-b5d2-6d44700bed41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:c3,bridge_name='br-int',has_traffic_filtering=True,id=e7910409-c383-428b-8942-02292d27e33e,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7910409-c3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG os_vif [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:c3,bridge_name='br-int',has_traffic_filtering=True,id=e7910409-c383-428b-8942-02292d27e33e,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7910409-c3') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7910409-c3, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7910409-c3, col_values=(('external_ids', {'iface-id': 'e7910409-c383-428b-8942-02292d27e33e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:ef:c3', 'vm-uuid': '85c48f53-33ae-43eb-b5d2-6d44700bed41'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:16 user nova-compute[73208]: INFO os_vif [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:c3,bridge_name='br-int',has_traffic_filtering=True,id=e7910409-c383-428b-8942-02292d27e33e,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7910409-c3')
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No VIF found with MAC fa:16:3e:b6:ef:c3, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-362b4eb3-54f7-49d6-b901-d5c1958db050 req-0af393ad-b614-4842-9689-bb5d3a008b66 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Updated VIF entry in instance network info cache for port e7910409-c383-428b-8942-02292d27e33e. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-362b4eb3-54f7-49d6-b901-d5c1958db050 req-0af393ad-b614-4842-9689-bb5d3a008b66 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Updating instance_info_cache with network_info: [{"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:23:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-362b4eb3-54f7-49d6-b901-d5c1958db050 req-0af393ad-b614-4842-9689-bb5d3a008b66 service nova] Releasing lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:23:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-b0c1e074-2e46-4ee4-a892-9dcea4cfebd7 req-d657c03f-a171-4d19-8a25-411b0898cc2c service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received event network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0c1e074-2e46-4ee4-a892-9dcea4cfebd7 req-d657c03f-a171-4d19-8a25-411b0898cc2c service nova] Acquiring lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0c1e074-2e46-4ee4-a892-9dcea4cfebd7 req-d657c03f-a171-4d19-8a25-411b0898cc2c service nova] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0c1e074-2e46-4ee4-a892-9dcea4cfebd7 req-d657c03f-a171-4d19-8a25-411b0898cc2c service nova] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-b0c1e074-2e46-4ee4-a892-9dcea4cfebd7 req-d657c03f-a171-4d19-8a25-411b0898cc2c service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] No waiting events found dispatching network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:18 user nova-compute[73208]: WARNING nova.compute.manager [req-b0c1e074-2e46-4ee4-a892-9dcea4cfebd7 req-d657c03f-a171-4d19-8a25-411b0898cc2c service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received unexpected event network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e for instance with vm_state building and task_state spawning.
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-f8316a70-bb66-469c-9fbc-9f1ee0298c4f req-03adc60d-9328-4eff-bf95-39ac6976d140 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received event network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f8316a70-bb66-469c-9fbc-9f1ee0298c4f req-03adc60d-9328-4eff-bf95-39ac6976d140 service nova] Acquiring lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f8316a70-bb66-469c-9fbc-9f1ee0298c4f req-03adc60d-9328-4eff-bf95-39ac6976d140 service nova] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f8316a70-bb66-469c-9fbc-9f1ee0298c4f req-03adc60d-9328-4eff-bf95-39ac6976d140 service nova] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-f8316a70-bb66-469c-9fbc-9f1ee0298c4f req-03adc60d-9328-4eff-bf95-39ac6976d140 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] No waiting events found dispatching network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:20 user nova-compute[73208]: WARNING nova.compute.manager [req-f8316a70-bb66-469c-9fbc-9f1ee0298c4f req-03adc60d-9328-4eff-bf95-39ac6976d140 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received unexpected event network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e for instance with vm_state building and task_state spawning.
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177800.346896, 85c48f53-33ae-43eb-b5d2-6d44700bed41 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:23:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] VM Resumed (Lifecycle Event)
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:23:20 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Instance spawned successfully.
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177800.3487236, 85c48f53-33ae-43eb-b5d2-6d44700bed41 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:23:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] VM Started (Lifecycle Event)
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:23:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:23:20 user nova-compute[73208]: INFO nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 16 09:23:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:20 user nova-compute[73208]: INFO nova.compute.manager [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Took 7.44 seconds to build instance.
Aug 16 09:23:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-19fc2b58-6b6c-4d31-8d24-6201a3625570 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.617s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:24 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:23:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:23:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:23:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:23:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:23:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7660MB free_disk=25.399864196777344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ce7f5083-c390-4418-9e65-5abc231a12fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 449e3892-5f7f-41df-828e-75573ad2d8a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 85c48f53-33ae-43eb-b5d2-6d44700bed41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:23:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:32 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:23:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:23:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:23:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:38 user nova-compute[73208]: INFO nova.compute.manager [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Detaching volume 4820c7aa-bf06-4104-b53c-57b6d82adb9a
Aug 16 09:23:39 user nova-compute[73208]: INFO nova.virt.block_device [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Attempting to driver detach volume 4820c7aa-bf06-4104-b53c-57b6d82adb9a from mountpoint /dev/vdb
Aug 16 09:23:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Attempting to detach device vdb from instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:23:39 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:23:39 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:23:39 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:23:39 user nova-compute[73208]:   <serial>4820c7aa-bf06-4104-b53c-57b6d82adb9a</serial>
Aug 16 09:23:39 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:23:39 user nova-compute[73208]: </disk>
Aug 16 09:23:39 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:23:39 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Successfully detached device vdb from instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 from the persistent domain config.
Aug 16 09:23:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:23:39 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:23:39 user nova-compute[73208]:   <source dev="/dev/sdf"/>
Aug 16 09:23:39 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:23:39 user nova-compute[73208]:   <serial>4820c7aa-bf06-4104-b53c-57b6d82adb9a</serial>
Aug 16 09:23:39 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:23:39 user nova-compute[73208]: </disk>
Aug 16 09:23:39 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177819.4817016, 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:23:39 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Successfully detached device vdb from instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 from the live domain config.
Aug 16 09:23:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmuASGJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:23:39 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eff2d7-aa7a-4b1f-b6f2-b32bae639955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fa3be6-16fc-45a8-8e12-47b60f23a244]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:23:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:23:39 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:23:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f4303e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a'): ({'sdf'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Removing single pathed devices sdf {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ff5805-97b0-4619-8096-5bd71fdc9886]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a741164-fd8b-4f37-aa66-e2605bf8a4e1]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Flushing IO for device /dev/sdf {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffc0d02-95b5-4d43-aa9f-b3093c2f68e1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[db49e407-5fb6-4756-97b0-92aa706edce9]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] SCSI volumes sdf have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca8591d-0f90-4d8f-b119-de3968b535a8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b6279-89f1-4ec6-bde0-f643354806cd]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a, portal: 172.16.0.220,3260]
Aug 16 09:23:39 user nova-compute[73208]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a, portal: 172.16.0.220,3260] successful.
Aug 16 09:23:39 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee646e59-ac92-4ac3-8b4f-e84715a8fa03]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] <== disconnect_volume: return (341ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:23:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:23:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:23:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:23:41 user nova-compute[73208]: INFO nova.compute.claims [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Claim successful on node user
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:23:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.policy [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c2938a42c1a48f9aaf08f9b11580521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6253d83a854c2599f96025ffb8cf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:23:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Creating image(s)
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "/opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "/opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk 1073741824" returned: 0 in 0.053s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Successfully created port: 96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Cannot resize image /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lazy-loading 'migration_context' on Instance uuid c8ad53de-14b1-4358-9dad-da0ea5bed5d1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Ensure instance console log exists: /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Successfully updated port: 96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquired lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-2f8f2f39-2ba3-442d-8346-35062eb73a76 req-1eaeae2e-766e-4d43-8916-d76417c3c8e3 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received event network-changed-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-2f8f2f39-2ba3-442d-8346-35062eb73a76 req-1eaeae2e-766e-4d43-8916-d76417c3c8e3 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Refreshing instance network info cache due to event network-changed-96fb7389-8d6a-4b62-9057-0977b775e307. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2f8f2f39-2ba3-442d-8346-35062eb73a76 req-1eaeae2e-766e-4d43-8916-d76417c3c8e3 service nova] Acquiring lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Updating instance_info_cache with network_info: [{"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Releasing lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Instance network_info: |[{"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2f8f2f39-2ba3-442d-8346-35062eb73a76 req-1eaeae2e-766e-4d43-8916-d76417c3c8e3 service nova] Acquired lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-2f8f2f39-2ba3-442d-8346-35062eb73a76 req-1eaeae2e-766e-4d43-8916-d76417c3c8e3 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Refreshing network info cache for port 96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Start _get_guest_xml network_info=[{"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:23:44 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:23:44 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-611427825',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-611427825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6114278',id=32,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5/2u+QYNIZ0j00iJaPUYLX/pCntNC4+U66Z0/+JiVagNJ/CJrfmoAF3uJwhTJnmHWyaZrQKbi7oZHxIKa2ejaqWnTf1QzK2FPcYhK93lKj7Wojf7KXxT0/7BUydV5tiQ==',key_name='tempest-keypair-366517279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c6253d83a854c2599f96025ffb8cf26',ramdisk_id='',reservation_id='r-bqwkzitu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151097611',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c2938a42c1a48f9aaf08f9b11580521',uuid=c8ad53de-14b1-4358-9dad-da0ea5bed5d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Converting VIF {"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=96fb7389-8d6a-4b62-9057-0977b775e307,network=Network(841c4cf0-e2d6-462f-8e0b-8cf2a90680f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fb7389-8d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lazy-loading 'pci_devices' on Instance uuid c8ad53de-14b1-4358-9dad-da0ea5bed5d1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:23:44 user nova-compute[73208]:   <uuid>c8ad53de-14b1-4358-9dad-da0ea5bed5d1</uuid>
Aug 16 09:23:44 user nova-compute[73208]:   <name>instance-00000020</name>
Aug 16 09:23:44 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:23:44 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:23:44 user nova-compute[73208]:   <metadata>
Aug 16 09:23:44 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:23:44 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:23:44 user nova-compute[73208]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-611427825</nova:name>
Aug 16 09:23:44 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:23:44</nova:creationTime>
Aug 16 09:23:44 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:23:44 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:23:44 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:23:44 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:23:44 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:23:44 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:23:44 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:23:44 user nova-compute[73208]:       <nova:owner>
Aug 16 09:23:44 user nova-compute[73208]:         <nova:user uuid="7c2938a42c1a48f9aaf08f9b11580521">tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member</nova:user>
Aug 16 09:23:44 user nova-compute[73208]:         <nova:project uuid="5c6253d83a854c2599f96025ffb8cf26">tempest-TestServerVolumeAttachScenarioOldVersion-151097611</nova:project>
Aug 16 09:23:44 user nova-compute[73208]:       </nova:owner>
Aug 16 09:23:44 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:23:44 user nova-compute[73208]:       <nova:ports>
Aug 16 09:23:44 user nova-compute[73208]:         <nova:port uuid="96fb7389-8d6a-4b62-9057-0977b775e307">
Aug 16 09:23:44 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 09:23:44 user nova-compute[73208]:         </nova:port>
Aug 16 09:23:44 user nova-compute[73208]:       </nova:ports>
Aug 16 09:23:44 user nova-compute[73208]:     </nova:instance>
Aug 16 09:23:44 user nova-compute[73208]:   </metadata>
Aug 16 09:23:44 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:23:44 user nova-compute[73208]:     <system>
Aug 16 09:23:44 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:23:44 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:23:44 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:23:44 user nova-compute[73208]:       <entry name="serial">c8ad53de-14b1-4358-9dad-da0ea5bed5d1</entry>
Aug 16 09:23:44 user nova-compute[73208]:       <entry name="uuid">c8ad53de-14b1-4358-9dad-da0ea5bed5d1</entry>
Aug 16 09:23:44 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:23:44 user nova-compute[73208]:     </system>
Aug 16 09:23:44 user nova-compute[73208]:   </sysinfo>
Aug 16 09:23:44 user nova-compute[73208]:   <os>
Aug 16 09:23:44 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:23:44 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:23:44 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:23:44 user nova-compute[73208]:   </os>
Aug 16 09:23:44 user nova-compute[73208]:   <features>
Aug 16 09:23:44 user nova-compute[73208]:     <acpi/>
Aug 16 09:23:44 user nova-compute[73208]:     <apic/>
Aug 16 09:23:44 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:23:44 user nova-compute[73208]:   </features>
Aug 16 09:23:44 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:23:44 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:23:44 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:23:44 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:23:44 user nova-compute[73208]:   </clock>
Aug 16 09:23:44 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:23:44 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:23:44 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:23:44 user nova-compute[73208]:   </cpu>
Aug 16 09:23:44 user nova-compute[73208]:   <devices>
Aug 16 09:23:44 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:23:44 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:23:44 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk"/>
Aug 16 09:23:44 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:23:44 user nova-compute[73208]:     </disk>
Aug 16 09:23:44 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:23:44 user nova-compute[73208]:       <mac address="fa:16:3e:d0:54:dd"/>
Aug 16 09:23:44 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:23:44 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:23:44 user nova-compute[73208]:       <target dev="tap96fb7389-8d"/>
Aug 16 09:23:44 user nova-compute[73208]:     </interface>
Aug 16 09:23:44 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:23:44 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/console.log" append="off"/>
Aug 16 09:23:44 user nova-compute[73208]:     </serial>
Aug 16 09:23:44 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:23:44 user nova-compute[73208]:     <video>
Aug 16 09:23:44 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:23:44 user nova-compute[73208]:     </video>
Aug 16 09:23:44 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:23:44 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:23:44 user nova-compute[73208]:     </rng>
Aug 16 09:23:44 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:23:44 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:23:44 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:23:44 user nova-compute[73208]:     </memballoon>
Aug 16 09:23:44 user nova-compute[73208]:   </devices>
Aug 16 09:23:44 user nova-compute[73208]: </domain>
Aug 16 09:23:44 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-611427825',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-611427825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6114278',id=32,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5/2u+QYNIZ0j00iJaPUYLX/pCntNC4+U66Z0/+JiVagNJ/CJrfmoAF3uJwhTJnmHWyaZrQKbi7oZHxIKa2ejaqWnTf1QzK2FPcYhK93lKj7Wojf7KXxT0/7BUydV5tiQ==',key_name='tempest-keypair-366517279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c6253d83a854c2599f96025ffb8cf26',ramdisk_id='',reservation_id='r-bqwkzitu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151097611',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c2938a42c1a48f9aaf08f9b11580521',uuid=c8ad53de-14b1-4358-9dad-da0ea5bed5d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Converting VIF {"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=96fb7389-8d6a-4b62-9057-0977b775e307,network=Network(841c4cf0-e2d6-462f-8e0b-8cf2a90680f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fb7389-8d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG os_vif [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=96fb7389-8d6a-4b62-9057-0977b775e307,network=Network(841c4cf0-e2d6-462f-8e0b-8cf2a90680f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fb7389-8d') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96fb7389-8d, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96fb7389-8d, col_values=(('external_ids', {'iface-id': '96fb7389-8d6a-4b62-9057-0977b775e307', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:54:dd', 'vm-uuid': 'c8ad53de-14b1-4358-9dad-da0ea5bed5d1'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:44 user nova-compute[73208]: INFO os_vif [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=96fb7389-8d6a-4b62-9057-0977b775e307,network=Network(841c4cf0-e2d6-462f-8e0b-8cf2a90680f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fb7389-8d')
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] No VIF found with MAC fa:16:3e:d0:54:dd, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-2f8f2f39-2ba3-442d-8346-35062eb73a76 req-1eaeae2e-766e-4d43-8916-d76417c3c8e3 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Updated VIF entry in instance network info cache for port 96fb7389-8d6a-4b62-9057-0977b775e307. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-2f8f2f39-2ba3-442d-8346-35062eb73a76 req-1eaeae2e-766e-4d43-8916-d76417c3c8e3 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Updating instance_info_cache with network_info: [{"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:23:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2f8f2f39-2ba3-442d-8346-35062eb73a76 req-1eaeae2e-766e-4d43-8916-d76417c3c8e3 service nova] Releasing lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:23:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-b0ef5cac-3879-4436-b53d-ab6ee0f43bb3 req-b7d091e4-4a42-4d38-9baf-defb8bf18479 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received event network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0ef5cac-3879-4436-b53d-ab6ee0f43bb3 req-b7d091e4-4a42-4d38-9baf-defb8bf18479 service nova] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0ef5cac-3879-4436-b53d-ab6ee0f43bb3 req-b7d091e4-4a42-4d38-9baf-defb8bf18479 service nova] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b0ef5cac-3879-4436-b53d-ab6ee0f43bb3 req-b7d091e4-4a42-4d38-9baf-defb8bf18479 service nova] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-b0ef5cac-3879-4436-b53d-ab6ee0f43bb3 req-b7d091e4-4a42-4d38-9baf-defb8bf18479 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] No waiting events found dispatching network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:46 user nova-compute[73208]: WARNING nova.compute.manager [req-b0ef5cac-3879-4436-b53d-ab6ee0f43bb3 req-b7d091e4-4a42-4d38-9baf-defb8bf18479 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received unexpected event network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 for instance with vm_state building and task_state spawning.
Aug 16 09:23:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:46 user nova-compute[73208]: INFO nova.compute.manager [None req-8959a3d4-7b12-4feb-b160-056233af8585 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Get console output
Aug 16 09:23:46 user nova-compute[73208]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'flavor' on Instance uuid 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7da0dfb1-4b69-4b77-a37b-ac04c118ec03 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.115s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 8.843s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:48 user nova-compute[73208]: INFO nova.compute.manager [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Terminating instance
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177828.0852935, c8ad53de-14b1-4358-9dad-da0ea5bed5d1 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:23:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] VM Resumed (Lifecycle Event)
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:23:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Instance spawned successfully.
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:23:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177828.086877, c8ad53de-14b1-4358-9dad-da0ea5bed5d1 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:23:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] VM Started (Lifecycle Event)
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:23:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:23:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:48 user nova-compute[73208]: INFO nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-38e7b5b1-acdc-40ba-b2fe-fa7b7222d681 req-280372c9-0c72-4d69-8b3f-9df66bba8e92 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received event network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-38e7b5b1-acdc-40ba-b2fe-fa7b7222d681 req-280372c9-0c72-4d69-8b3f-9df66bba8e92 service nova] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-38e7b5b1-acdc-40ba-b2fe-fa7b7222d681 req-280372c9-0c72-4d69-8b3f-9df66bba8e92 service nova] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-38e7b5b1-acdc-40ba-b2fe-fa7b7222d681 req-280372c9-0c72-4d69-8b3f-9df66bba8e92 service nova] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-38e7b5b1-acdc-40ba-b2fe-fa7b7222d681 req-280372c9-0c72-4d69-8b3f-9df66bba8e92 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] No waiting events found dispatching network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:48 user nova-compute[73208]: WARNING nova.compute.manager [req-38e7b5b1-acdc-40ba-b2fe-fa7b7222d681 req-280372c9-0c72-4d69-8b3f-9df66bba8e92 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received unexpected event network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 for instance with vm_state building and task_state spawning.
Aug 16 09:23:48 user nova-compute[73208]: INFO nova.compute.manager [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Took 6.37 seconds to build instance.
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-22d4367f-b588-4781-be9e-f9a0157d1d55 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.493s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-6b1c7393-346d-4300-9ea7-905ae8966226 req-217c2c84-b6ac-4463-b2b7-521a924fe78d service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received event network-vif-unplugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6b1c7393-346d-4300-9ea7-905ae8966226 req-217c2c84-b6ac-4463-b2b7-521a924fe78d service nova] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6b1c7393-346d-4300-9ea7-905ae8966226 req-217c2c84-b6ac-4463-b2b7-521a924fe78d service nova] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6b1c7393-346d-4300-9ea7-905ae8966226 req-217c2c84-b6ac-4463-b2b7-521a924fe78d service nova] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-6b1c7393-346d-4300-9ea7-905ae8966226 req-217c2c84-b6ac-4463-b2b7-521a924fe78d service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] No waiting events found dispatching network-vif-unplugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-6b1c7393-346d-4300-9ea7-905ae8966226 req-217c2c84-b6ac-4463-b2b7-521a924fe78d service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received event network-vif-unplugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:23:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Instance destroyed successfully.
Aug 16 09:23:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'resources' on Instance uuid 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1966686963',display_name='tempest-VolumesSnapshotTestJSON-instance-1966686963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1966686963',id=28,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdUIQapc1tPD5jZPZvpI4QhXAKuY/b6e3WWVDK7rwH8zatqkfka3dvpYzbfJySTTNm7qaDzEw/+PacmsUp6Ig7Pi77TVmCtmNJ1YHGz40LYaa8q0j+eYeKp1c9tuWYn4A==',key_name='tempest-keypair-1211661055',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:20:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75db810c942649859c59c7e7eb85b96c',ramdisk_id='',reservation_id='r-4nodlwg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1665109562',owner_user_name='tempest-VolumesSnapshotTestJSON-1665109562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:20:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e7700a95794faca71c1781b2991241',uuid=1b7f300f-24ac-4b6f-a59b-fc1deb3065c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converting VIF {"id": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "address": "fa:16:3e:c3:a8:2a", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd993aab2-6e", "ovs_interfaceid": "d993aab2-6e2d-410c-9538-d9b0bbcc560d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:a8:2a,bridge_name='br-int',has_traffic_filtering=True,id=d993aab2-6e2d-410c-9538-d9b0bbcc560d,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd993aab2-6e') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_vif [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:a8:2a,bridge_name='br-int',has_traffic_filtering=True,id=d993aab2-6e2d-410c-9538-d9b0bbcc560d,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd993aab2-6e') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd993aab2-6e, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:23:49 user nova-compute[73208]: INFO os_vif [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:a8:2a,bridge_name='br-int',has_traffic_filtering=True,id=d993aab2-6e2d-410c-9538-d9b0bbcc560d,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd993aab2-6e')
Aug 16 09:23:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmuASGJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:23:49 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4820c7aa-bf06-4104-b53c-57b6d82adb9a', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f44c6e4-cb21-4471-95e0-3e935d6a9e46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a4593-106a-414e-ac37-64a7911a4728]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:23:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:23:49 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:23:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f0041990>, {}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Disconnecting from: [] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] <== disconnect_volume: return (65ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:23:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Deleting instance files /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4_del
Aug 16 09:23:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Deletion of /opt/stack/data/nova/instances/1b7f300f-24ac-4b6f-a59b-fc1deb3065c4_del complete
Aug 16 09:23:49 user nova-compute[73208]: INFO nova.compute.manager [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 16 09:23:49 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:23:49 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:23:50 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Took 1.04 seconds to deallocate network for instance.
Aug 16 09:23:50 user nova-compute[73208]: WARNING nova.volume.cinder [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Attachment f6fb2035-a644-414a-a1da-ce3fee7a6832 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f6fb2035-a644-414a-a1da-ce3fee7a6832. (HTTP 404) (Request-ID: req-f2c42718-9a3d-4a37-a760-9f10d9df75c2)
Aug 16 09:23:50 user nova-compute[73208]: INFO nova.compute.manager [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Took 0.03 seconds to detach 1 volumes for instance.
Aug 16 09:23:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-fde24dc9-814a-42ed-ad6d-7e299f5a170c req-e6bcffc4-8f27-4c3f-ac94-98abdbfe02fa service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received event network-vif-deleted-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-63195b81-dfeb-4f3d-8f25-34d999b707ab req-ea55c31f-1f71-4862-8b6a-8d2d28d106a6 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received event network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-63195b81-dfeb-4f3d-8f25-34d999b707ab req-ea55c31f-1f71-4862-8b6a-8d2d28d106a6 service nova] Acquiring lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-63195b81-dfeb-4f3d-8f25-34d999b707ab req-ea55c31f-1f71-4862-8b6a-8d2d28d106a6 service nova] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-63195b81-dfeb-4f3d-8f25-34d999b707ab req-ea55c31f-1f71-4862-8b6a-8d2d28d106a6 service nova] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-63195b81-dfeb-4f3d-8f25-34d999b707ab req-ea55c31f-1f71-4862-8b6a-8d2d28d106a6 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] No waiting events found dispatching network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:23:50 user nova-compute[73208]: WARNING nova.compute.manager [req-63195b81-dfeb-4f3d-8f25-34d999b707ab req-ea55c31f-1f71-4862-8b6a-8d2d28d106a6 service nova] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Received unexpected event network-vif-plugged-d993aab2-6e2d-410c-9538-d9b0bbcc560d for instance with vm_state deleted and task_state None.
Aug 16 09:23:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:23:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:50 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Deleted allocations for instance 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4
Aug 16 09:23:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-de2802c9-2b03-4e2e-a2e6-474432291006 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "1b7f300f-24ac-4b6f-a59b-fc1deb3065c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.840s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:23:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:23:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:04 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177829.0281322, 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:24:04 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] VM Stopped (Lifecycle Event)
Aug 16 09:24:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1b363211-13c5-4602-a973-d1372757f146 None None] [instance: 1b7f300f-24ac-4b6f-a59b-fc1deb3065c4] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:24:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:24:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:24:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:24:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:25 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:25 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:24:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:24:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:24:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:24:28 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:24:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7524MB free_disk=25.367938995361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:24:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ce7f5083-c390-4418-9e65-5abc231a12fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 449e3892-5f7f-41df-828e-75573ad2d8a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 85c48f53-33ae-43eb-b5d2-6d44700bed41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-60635a06-a3b8-457d-be91-2784235d3dd5 req-0830c22f-5545-4c63-904f-ff1ad3e794d9 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-changed-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-60635a06-a3b8-457d-be91-2784235d3dd5 req-0830c22f-5545-4c63-904f-ff1ad3e794d9 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing instance network info cache due to event network-changed-52a7ad9a-8d25-4e56-8341-09d8e5d63f97. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-60635a06-a3b8-457d-be91-2784235d3dd5 req-0830c22f-5545-4c63-904f-ff1ad3e794d9 service nova] Acquiring lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-60635a06-a3b8-457d-be91-2784235d3dd5 req-0830c22f-5545-4c63-904f-ff1ad3e794d9 service nova] Acquired lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG nova.network.neutron [req-60635a06-a3b8-457d-be91-2784235d3dd5 req-0830c22f-5545-4c63-904f-ff1ad3e794d9 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Refreshing network info cache for port 52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG nova.network.neutron [req-60635a06-a3b8-457d-be91-2784235d3dd5 req-0830c22f-5545-4c63-904f-ff1ad3e794d9 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updated VIF entry in instance network info cache for port 52a7ad9a-8d25-4e56-8341-09d8e5d63f97. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG nova.network.neutron [req-60635a06-a3b8-457d-be91-2784235d3dd5 req-0830c22f-5545-4c63-904f-ff1ad3e794d9 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-60635a06-a3b8-457d-be91-2784235d3dd5 req-0830c22f-5545-4c63-904f-ff1ad3e794d9 service nova] Releasing lock "refresh_cache-449e3892-5f7f-41df-828e-75573ad2d8a8" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:24:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:32 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid aeff110f-8cbd-480d-8654-b0daee121eb7 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:33 user nova-compute[73208]: INFO nova.compute.manager [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Terminating instance
Aug 16 09:24:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-def63dba-3faa-4fc7-b5c4-8c442ea900b3 req-d6d53c07-476d-44a6-975f-c7d943791881 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-def63dba-3faa-4fc7-b5c4-8c442ea900b3 req-d6d53c07-476d-44a6-975f-c7d943791881 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-def63dba-3faa-4fc7-b5c4-8c442ea900b3 req-d6d53c07-476d-44a6-975f-c7d943791881 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-def63dba-3faa-4fc7-b5c4-8c442ea900b3 req-d6d53c07-476d-44a6-975f-c7d943791881 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-def63dba-3faa-4fc7-b5c4-8c442ea900b3 req-d6d53c07-476d-44a6-975f-c7d943791881 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-unplugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-def63dba-3faa-4fc7-b5c4-8c442ea900b3 req-d6d53c07-476d-44a6-975f-c7d943791881 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-3bb8e426-d20c-42ff-aed0-98dc70707ac7 req-2c3d755d-da60-4101-9537-6de5da12ceb5 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3bb8e426-d20c-42ff-aed0-98dc70707ac7 req-2c3d755d-da60-4101-9537-6de5da12ceb5 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3bb8e426-d20c-42ff-aed0-98dc70707ac7 req-2c3d755d-da60-4101-9537-6de5da12ceb5 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3bb8e426-d20c-42ff-aed0-98dc70707ac7 req-2c3d755d-da60-4101-9537-6de5da12ceb5 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-3bb8e426-d20c-42ff-aed0-98dc70707ac7 req-2c3d755d-da60-4101-9537-6de5da12ceb5 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-unplugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-3bb8e426-d20c-42ff-aed0-98dc70707ac7 req-2c3d755d-da60-4101-9537-6de5da12ceb5 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [{"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-aeff110f-8cbd-480d-8654-b0daee121eb7" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee7240ac-17da-479c-965f-0fddaa5ce5c2 req-71bf3619-599d-427d-85a0-e5032e7d3295 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee7240ac-17da-479c-965f-0fddaa5ce5c2 req-71bf3619-599d-427d-85a0-e5032e7d3295 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee7240ac-17da-479c-965f-0fddaa5ce5c2 req-71bf3619-599d-427d-85a0-e5032e7d3295 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee7240ac-17da-479c-965f-0fddaa5ce5c2 req-71bf3619-599d-427d-85a0-e5032e7d3295 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee7240ac-17da-479c-965f-0fddaa5ce5c2 req-71bf3619-599d-427d-85a0-e5032e7d3295 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-unplugged-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee7240ac-17da-479c-965f-0fddaa5ce5c2 req-71bf3619-599d-427d-85a0-e5032e7d3295 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-7c0d2f58-470c-44d2-8162-2a75697a5200 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:24:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Instance destroyed successfully.
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.objects.instance [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lazy-loading 'resources' on Instance uuid 449e3892-5f7f-41df-828e-75573ad2d8a8 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:57:32,bridge_name='br-int',has_traffic_filtering=True,id=52a7ad9a-8d25-4e56-8341-09d8e5d63f97,network=Network(40209d30-c9fe-431b-9f3a-75c2a4320835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a7ad9a-8d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:57:32,bridge_name='br-int',has_traffic_filtering=True,id=52a7ad9a-8d25-4e56-8341-09d8e5d63f97,network=Network(40209d30-c9fe-431b-9f3a-75c2a4320835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a7ad9a-8d') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52a7ad9a-8d, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: INFO os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:57:32,bridge_name='br-int',has_traffic_filtering=True,id=52a7ad9a-8d25-4e56-8341-09d8e5d63f97,network=Network(40209d30-c9fe-431b-9f3a-75c2a4320835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a7ad9a-8d')
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a0:b5,bridge_name='br-int',has_traffic_filtering=True,id=da74aba8-33f2-4275-aba9-e6a9e5c3cee2,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda74aba8-33') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a0:b5,bridge_name='br-int',has_traffic_filtering=True,id=da74aba8-33f2-4275-aba9-e6a9e5c3cee2,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda74aba8-33') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda74aba8-33, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: INFO os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a0:b5,bridge_name='br-int',has_traffic_filtering=True,id=da74aba8-33f2-4275-aba9-e6a9e5c3cee2,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda74aba8-33')
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:e7,bridge_name='br-int',has_traffic_filtering=True,id=a11751ed-e5e6-4393-b9d0-7e51ff91c2b3,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa11751ed-e5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:e7,bridge_name='br-int',has_traffic_filtering=True,id=a11751ed-e5e6-4393-b9d0-7e51ff91c2b3,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa11751ed-e5') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa11751ed-e5, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: INFO os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:e7,bridge_name='br-int',has_traffic_filtering=True,id=a11751ed-e5e6-4393-b9d0-7e51ff91c2b3,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa11751ed-e5')
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:12:67,bridge_name='br-int',has_traffic_filtering=True,id=43bd38d9-43ea-4cbe-a19c-7c223489ff4f,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bd38d9-43') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:12:67,bridge_name='br-int',has_traffic_filtering=True,id=43bd38d9-43ea-4cbe-a19c-7c223489ff4f,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bd38d9-43') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43bd38d9-43, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: INFO os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:12:67,bridge_name='br-int',has_traffic_filtering=True,id=43bd38d9-43ea-4cbe-a19c-7c223489ff4f,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bd38d9-43')
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:c6,bridge_name='br-int',has_traffic_filtering=True,id=1de5138b-21d7-429a-ab10-056116c3d4dc,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de5138b-21') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:c6,bridge_name='br-int',has_traffic_filtering=True,id=1de5138b-21d7-429a-ab10-056116c3d4dc,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de5138b-21') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1de5138b-21, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: INFO os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:c6,bridge_name='br-int',has_traffic_filtering=True,id=1de5138b-21d7-429a-ab10-056116c3d4dc,network=Network(bdc69831-f444-4912-9ff0-78a7ec62c36c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de5138b-21')
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "7c0d2f58-470c-44d2-8162-2a75697a5200", "address": "fa:16:3e:1b:29:ec", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0d2f58-47", "ovs_interfaceid": "7c0d2f58-470c-44d2-8162-2a75697a5200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c0d2f58-470c-44d2-8162-2a75697a5200,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0d2f58-47') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c0d2f58-470c-44d2-8162-2a75697a5200,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0d2f58-47') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c0d2f58-47, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:36 user nova-compute[73208]: INFO os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c0d2f58-470c-44d2-8162-2a75697a5200,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0d2f58-47')
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T09:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850024993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850024993',id=30,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQgyEP38vJBHPLKhPVTXrtdw34rKnWJwJqHB713qbfEBT06perYbXiFY8YBZSMnxXElpWPqAlWFNLTGbAnqsN6ctxWEhMATrEsxoomemckXRkgg1vpIpAwPY3y6dRMaiA==',key_name='tempest-keypair-1867396066',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc1ea26bbdd41828ba691969efeb5a7',ramdisk_id='',reservation_id='r-l108381s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-502411029',owner_user_name='tempest-TaggedBootDevicesTest_v242-502411029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df5dc0b2a47e29d9471875a21b7d0',uuid=449e3892-5f7f-41df-828e-75573ad2d8a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converting VIF {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:1c,bridge_name='br-int',has_traffic_filtering=True,id=929e2681-835d-416b-9c55-3afe6319bdfb,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap929e2681-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:1c,bridge_name='br-int',has_traffic_filtering=True,id=929e2681-835d-416b-9c55-3afe6319bdfb,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap929e2681-83') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap929e2681-83, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:36 user nova-compute[73208]: INFO os_vif [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:1c,bridge_name='br-int',has_traffic_filtering=True,id=929e2681-835d-416b-9c55-3afe6319bdfb,network=Network(2f3bfa96-fd99-43fb-a754-7b8be071fe33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap929e2681-83')
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGhkbFns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:24:36 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dd1328-3478-4d90-a2a5-11873cb87a50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[114f0746-ab96-4634-b1cb-c955f6a7a9a7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:24:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:24:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f00f1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a4a1a9-879c-4ab9-9fef-c4882580bf48]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fea8c0-db6b-41ff-91a6-2a2c07f35a2e]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c827424a-2eeb-4a05-864e-d7df1815eee9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f91057-3588-4862-9b12-9eb2fb71aa75]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03e630-26ec-4b1d-9d5e-66bc8c141ca9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:36 user nova-compute[73208]: WARNING nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 for instance with vm_state active and task_state deleting.
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-unplugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:36 user nova-compute[73208]: WARNING nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-a11751ed-e5e6-4393-b9d0-7e51ff91c2b3 for instance with vm_state active and task_state deleting.
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-unplugged-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-1de5138b-21d7-429a-ab10-056116c3d4dc for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:36 user nova-compute[73208]: WARNING nova.compute.manager [req-3b0c71e8-ffbd-499e-b949-ceff840340d2 req-26d1e8b9-e315-463b-94f0-29e9bb41ddfc service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-1de5138b-21d7-429a-ab10-056116c3d4dc for instance with vm_state active and task_state deleting.
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a12768e-bd6f-4938-828a-d8c429ef0d81]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84, portal: 172.16.0.220,3260]
Aug 16 09:24:36 user nova-compute[73208]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84, portal: 172.16.0.220,3260] successful.
Aug 16 09:24:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:24:36 user nova-compute[73208]: INFO nova.compute.claims [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Claim successful on node user
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7b75c9-8778-4a6d-8067-0f86f0183c84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e58ccdb-bd07-4ac9-8c1c-5273372e0871]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== disconnect_volume: return (343ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erEZcbmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:24:36 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee09b055-65e8-4c72-9e20-4c9499d0f6f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f26ed-5d9c-4ac3-8060-86e65ae73601]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:24:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:24:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f00405e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be'): ({'sde'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Removing single pathed devices sde {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[916cf8a3-e40e-4f95-b642-2b1e2a962ffe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a0fd0-ed43-4fb2-aad3-9066b1c4c5f1]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Flushing IO for device /dev/sde {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bb79b5-b70c-4725-ab5d-249e2c57b0ff]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b17e14c-9c94-407e-a1e6-217efba3cd05]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2381dda-d024-4207-9e0d-731dfa3d4460]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4bfba-1e99-41b6-b039-b89528a4ee0a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be, portal: 172.16.0.220,3260]
Aug 16 09:24:36 user nova-compute[73208]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be, portal: 172.16.0.220,3260] successful.
Aug 16 09:24:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd02a00-6787-485e-b93e-9c54c146b8be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22c1dc8-7835-4e4e-af8c-a602c847d613]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== disconnect_volume: return (331ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWMthkgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:24:36 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca2a5c1-e142-4396-8048-f06d4637c12f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5110f5-d212-4ca0-9640-744052bfb495]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:24:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 (non-flash)
Aug 16 09:24:36 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:24:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f01fbd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58'): ({'sdg'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Removing single pathed devices sdg {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32fe556-c459-46c8-8224-63d9b77d10a7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bab660-c634-41a2-803c-f2e3f33877cb]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Flushing IO for device /dev/sdg {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b30f1c-e475-4068-b847-26446764ee11]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[032108f4-a368-4e25-865a-3b0ae982465d]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] SCSI volumes sdg have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28628f3-8976-4301-9f0a-056c7a09475b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:24:36 user nova-compute[73208]: DEBUG nova.network.neutron [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd20159-0f56-4869-9903-43c90925aa12]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58, portal: 172.16.0.220,3260]
Aug 16 09:24:37 user nova-compute[73208]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58, portal: 172.16.0.220,3260] successful.
Aug 16 09:24:37 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfff5891-02cb-423e-b9dc-8f268da25f58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d83a14-c9a9-401d-b521-2c335102fe4b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] <== disconnect_volume: return (312ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:24:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Deleting instance files /opt/stack/data/nova/instances/449e3892-5f7f-41df-828e-75573ad2d8a8_del
Aug 16 09:24:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Deletion of /opt/stack/data/nova/instances/449e3892-5f7f-41df-828e-75573ad2d8a8_del complete
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.policy [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91255b4dbf814537906275122738afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da0d7fd51c4dcaba48f74dc423e684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:24:37 user nova-compute[73208]: INFO nova.compute.manager [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Took 3.32 seconds to destroy the instance on the hypervisor.
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:24:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Creating image(s)
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "/opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "/opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:37 user nova-compute[73208]: WARNING nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-da74aba8-33f2-4275-aba9-e6a9e5c3cee2 for instance with vm_state active and task_state deleting.
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-unplugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:37 user nova-compute[73208]: WARNING nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-43bd38d9-43ea-4cbe-a19c-7c223489ff4f for instance with vm_state active and task_state deleting.
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-unplugged-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-unplugged-929e2681-835d-416b-9c55-3afe6319bdfb for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:37 user nova-compute[73208]: WARNING nova.compute.manager [req-07978afd-2d8b-40e2-8747-3d3df523134a req-e1986c36-eaf3-466f-b616-b4054e5774c1 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-929e2681-835d-416b-9c55-3afe6319bdfb for instance with vm_state active and task_state deleting.
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-f305f509-a281-4460-950d-014a23dc4ecc req-44757f63-dec6-402f-b63c-cbdd6dd9f1af service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f305f509-a281-4460-950d-014a23dc4ecc req-44757f63-dec6-402f-b63c-cbdd6dd9f1af service nova] Acquiring lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f305f509-a281-4460-950d-014a23dc4ecc req-44757f63-dec6-402f-b63c-cbdd6dd9f1af service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f305f509-a281-4460-950d-014a23dc4ecc req-44757f63-dec6-402f-b63c-cbdd6dd9f1af service nova] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-f305f509-a281-4460-950d-014a23dc4ecc req-44757f63-dec6-402f-b63c-cbdd6dd9f1af service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] No waiting events found dispatching network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:37 user nova-compute[73208]: WARNING nova.compute.manager [req-f305f509-a281-4460-950d-014a23dc4ecc req-44757f63-dec6-402f-b63c-cbdd6dd9f1af service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received unexpected event network-vif-plugged-7c0d2f58-470c-44d2-8162-2a75697a5200 for instance with vm_state active and task_state deleting.
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk 1073741824" returned: 0 in 0.056s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Successfully created port: c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.230s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:24:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Cannot resize image /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.objects.instance [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'migration_context' on Instance uuid 0b6a305b-662e-4498-ac23-99ccfe1fca4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Ensure instance console log exists: /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Successfully updated port: c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquired lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-1ac9ad9c-f92d-4a99-8187-b0e8a0b215b7 req-3c068782-439a-4ed7-b79c-058381a3f328 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received event network-changed-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-1ac9ad9c-f92d-4a99-8187-b0e8a0b215b7 req-3c068782-439a-4ed7-b79c-058381a3f328 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Refreshing instance network info cache due to event network-changed-c8626e65-b5f0-48eb-81d4-d2b819fa0580. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1ac9ad9c-f92d-4a99-8187-b0e8a0b215b7 req-3c068782-439a-4ed7-b79c-058381a3f328 service nova] Acquiring lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:24:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Updating instance_info_cache with network_info: [{"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Releasing lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Instance network_info: |[{"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1ac9ad9c-f92d-4a99-8187-b0e8a0b215b7 req-3c068782-439a-4ed7-b79c-058381a3f328 service nova] Acquired lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-1ac9ad9c-f92d-4a99-8187-b0e8a0b215b7 req-3c068782-439a-4ed7-b79c-058381a3f328 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Refreshing network info cache for port c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Start _get_guest_xml network_info=[{"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:24:39 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:24:39 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-723967379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-723967379',id=33,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-m8do8f2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:24:37Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=0b6a305b-662e-4498-ac23-99ccfe1fca4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:55:ec,bridge_name='br-int',has_traffic_filtering=True,id=c8626e65-b5f0-48eb-81d4-d2b819fa0580,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8626e65-b5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b6a305b-662e-4498-ac23-99ccfe1fca4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:24:39 user nova-compute[73208]:   <uuid>0b6a305b-662e-4498-ac23-99ccfe1fca4f</uuid>
Aug 16 09:24:39 user nova-compute[73208]:   <name>instance-00000021</name>
Aug 16 09:24:39 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:24:39 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:24:39 user nova-compute[73208]:   <metadata>
Aug 16 09:24:39 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:24:39 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:24:39 user nova-compute[73208]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-723967379</nova:name>
Aug 16 09:24:39 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:24:39</nova:creationTime>
Aug 16 09:24:39 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:24:39 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:24:39 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:24:39 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:24:39 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:24:39 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:24:39 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:24:39 user nova-compute[73208]:       <nova:owner>
Aug 16 09:24:39 user nova-compute[73208]:         <nova:user uuid="91255b4dbf814537906275122738afcf">tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member</nova:user>
Aug 16 09:24:39 user nova-compute[73208]:         <nova:project uuid="a5da0d7fd51c4dcaba48f74dc423e684">tempest-ServerBootFromVolumeStableRescueTest-1980932529</nova:project>
Aug 16 09:24:39 user nova-compute[73208]:       </nova:owner>
Aug 16 09:24:39 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:24:39 user nova-compute[73208]:       <nova:ports>
Aug 16 09:24:39 user nova-compute[73208]:         <nova:port uuid="c8626e65-b5f0-48eb-81d4-d2b819fa0580">
Aug 16 09:24:39 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 09:24:39 user nova-compute[73208]:         </nova:port>
Aug 16 09:24:39 user nova-compute[73208]:       </nova:ports>
Aug 16 09:24:39 user nova-compute[73208]:     </nova:instance>
Aug 16 09:24:39 user nova-compute[73208]:   </metadata>
Aug 16 09:24:39 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:24:39 user nova-compute[73208]:     <system>
Aug 16 09:24:39 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:24:39 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:24:39 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:24:39 user nova-compute[73208]:       <entry name="serial">0b6a305b-662e-4498-ac23-99ccfe1fca4f</entry>
Aug 16 09:24:39 user nova-compute[73208]:       <entry name="uuid">0b6a305b-662e-4498-ac23-99ccfe1fca4f</entry>
Aug 16 09:24:39 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:24:39 user nova-compute[73208]:     </system>
Aug 16 09:24:39 user nova-compute[73208]:   </sysinfo>
Aug 16 09:24:39 user nova-compute[73208]:   <os>
Aug 16 09:24:39 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:24:39 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:24:39 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:24:39 user nova-compute[73208]:   </os>
Aug 16 09:24:39 user nova-compute[73208]:   <features>
Aug 16 09:24:39 user nova-compute[73208]:     <acpi/>
Aug 16 09:24:39 user nova-compute[73208]:     <apic/>
Aug 16 09:24:39 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:24:39 user nova-compute[73208]:   </features>
Aug 16 09:24:39 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:24:39 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:24:39 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:24:39 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:24:39 user nova-compute[73208]:   </clock>
Aug 16 09:24:39 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:24:39 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:24:39 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:24:39 user nova-compute[73208]:   </cpu>
Aug 16 09:24:39 user nova-compute[73208]:   <devices>
Aug 16 09:24:39 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:24:39 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:24:39 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk"/>
Aug 16 09:24:39 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:24:39 user nova-compute[73208]:     </disk>
Aug 16 09:24:39 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:24:39 user nova-compute[73208]:       <mac address="fa:16:3e:80:55:ec"/>
Aug 16 09:24:39 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:24:39 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:24:39 user nova-compute[73208]:       <target dev="tapc8626e65-b5"/>
Aug 16 09:24:39 user nova-compute[73208]:     </interface>
Aug 16 09:24:39 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:24:39 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/console.log" append="off"/>
Aug 16 09:24:39 user nova-compute[73208]:     </serial>
Aug 16 09:24:39 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:24:39 user nova-compute[73208]:     <video>
Aug 16 09:24:39 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:24:39 user nova-compute[73208]:     </video>
Aug 16 09:24:39 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:24:39 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:24:39 user nova-compute[73208]:     </rng>
Aug 16 09:24:39 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:24:39 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:24:39 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:24:39 user nova-compute[73208]:     </memballoon>
Aug 16 09:24:39 user nova-compute[73208]:   </devices>
Aug 16 09:24:39 user nova-compute[73208]: </domain>
Aug 16 09:24:39 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-723967379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-723967379',id=33,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-m8do8f2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:24:37Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=0b6a305b-662e-4498-ac23-99ccfe1fca4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:55:ec,bridge_name='br-int',has_traffic_filtering=True,id=c8626e65-b5f0-48eb-81d4-d2b819fa0580,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8626e65-b5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG os_vif [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:55:ec,bridge_name='br-int',has_traffic_filtering=True,id=c8626e65-b5f0-48eb-81d4-d2b819fa0580,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8626e65-b5') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8626e65-b5, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8626e65-b5, col_values=(('external_ids', {'iface-id': 'c8626e65-b5f0-48eb-81d4-d2b819fa0580', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:55:ec', 'vm-uuid': '0b6a305b-662e-4498-ac23-99ccfe1fca4f'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:39 user nova-compute[73208]: INFO os_vif [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:55:ec,bridge_name='br-int',has_traffic_filtering=True,id=c8626e65-b5f0-48eb-81d4-d2b819fa0580,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8626e65-b5')
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No VIF found with MAC fa:16:3e:80:55:ec, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a8dd489-5691-42bb-8937-9b8c8d6da3bd req-1af59c67-a3a1-46ff-b8b0-54f1265ecb1e service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-deleted-7c0d2f58-470c-44d2-8162-2a75697a5200 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:39 user nova-compute[73208]: INFO nova.compute.manager [req-9a8dd489-5691-42bb-8937-9b8c8d6da3bd req-1af59c67-a3a1-46ff-b8b0-54f1265ecb1e service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Neutron deleted interface 7c0d2f58-470c-44d2-8162-2a75697a5200; detaching it from the instance and deleting it from the info cache
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-9a8dd489-5691-42bb-8937-9b8c8d6da3bd req-1af59c67-a3a1-46ff-b8b0-54f1265ecb1e service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de5138b-21d7-429a-ab10-056116c3d4dc", "address": "fa:16:3e:98:0b:c6", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de5138b-21", "ovs_interfaceid": "1de5138b-21d7-429a-ab10-056116c3d4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a8dd489-5691-42bb-8937-9b8c8d6da3bd req-1af59c67-a3a1-46ff-b8b0-54f1265ecb1e service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Detach interface failed, port_id=7c0d2f58-470c-44d2-8162-2a75697a5200, reason: Instance 449e3892-5f7f-41df-828e-75573ad2d8a8 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-1ac9ad9c-f92d-4a99-8187-b0e8a0b215b7 req-3c068782-439a-4ed7-b79c-058381a3f328 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Updated VIF entry in instance network info cache for port c8626e65-b5f0-48eb-81d4-d2b819fa0580. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-1ac9ad9c-f92d-4a99-8187-b0e8a0b215b7 req-3c068782-439a-4ed7-b79c-058381a3f328 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Updating instance_info_cache with network_info: [{"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1ac9ad9c-f92d-4a99-8187-b0e8a0b215b7 req-3c068782-439a-4ed7-b79c-058381a3f328 service nova] Releasing lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:24:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-deleted-1de5138b-21d7-429a-ab10-056116c3d4dc {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:41 user nova-compute[73208]: INFO nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Neutron deleted interface 1de5138b-21d7-429a-ab10-056116c3d4dc; detaching it from the instance and deleting it from the info cache
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.network.neutron [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "929e2681-835d-416b-9c55-3afe6319bdfb", "address": "fa:16:3e:23:4b:1c", "network": {"id": "2f3bfa96-fd99-43fb-a754-7b8be071fe33", "bridge": "br-int", "label": "tempest-device-tagging-net2-151525535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap929e2681-83", "ovs_interfaceid": "929e2681-835d-416b-9c55-3afe6319bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Detach interface failed, port_id=1de5138b-21d7-429a-ab10-056116c3d4dc, reason: Instance 449e3892-5f7f-41df-828e-75573ad2d8a8 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-deleted-929e2681-835d-416b-9c55-3afe6319bdfb {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:41 user nova-compute[73208]: INFO nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Neutron deleted interface 929e2681-835d-416b-9c55-3afe6319bdfb; detaching it from the instance and deleting it from the info cache
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.network.neutron [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "address": "fa:16:3e:a4:12:67", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bd38d9-43", "ovs_interfaceid": "43bd38d9-43ea-4cbe-a19c-7c223489ff4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Detach interface failed, port_id=929e2681-835d-416b-9c55-3afe6319bdfb, reason: Instance 449e3892-5f7f-41df-828e-75573ad2d8a8 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-deleted-43bd38d9-43ea-4cbe-a19c-7c223489ff4f {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:41 user nova-compute[73208]: INFO nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Neutron deleted interface 43bd38d9-43ea-4cbe-a19c-7c223489ff4f; detaching it from the instance and deleting it from the info cache
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.network.neutron [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [{"id": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "address": "fa:16:3e:4f:57:32", "network": {"id": "40209d30-c9fe-431b-9f3a-75c2a4320835", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-23558937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a7ad9a-8d", "ovs_interfaceid": "52a7ad9a-8d25-4e56-8341-09d8e5d63f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "address": "fa:16:3e:03:a0:b5", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda74aba8-33", "ovs_interfaceid": "da74aba8-33f2-4275-aba9-e6a9e5c3cee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "address": "fa:16:3e:da:67:e7", "network": {"id": "bdc69831-f444-4912-9ff0-78a7ec62c36c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1689190636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0fc1ea26bbdd41828ba691969efeb5a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11751ed-e5", "ovs_interfaceid": "a11751ed-e5e6-4393-b9d0-7e51ff91c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Detach interface failed, port_id=43bd38d9-43ea-4cbe-a19c-7c223489ff4f, reason: Instance 449e3892-5f7f-41df-828e-75573ad2d8a8 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received event network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] Acquiring lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] No waiting events found dispatching network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:41 user nova-compute[73208]: WARNING nova.compute.manager [req-d8038f7b-46d6-45ca-a312-cf58f43cdadf req-b8a3df9b-ecdf-4703-a97e-0d848de40089 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received unexpected event network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 for instance with vm_state building and task_state spawning.
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:42 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Took 5.13 seconds to deallocate network for instance.
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177882.8591976, 0b6a305b-662e-4498-ac23-99ccfe1fca4f => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:24:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] VM Resumed (Lifecycle Event)
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:24:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Instance spawned successfully.
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:24:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177882.86078, 0b6a305b-662e-4498-ac23-99ccfe1fca4f => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:24:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] VM Started (Lifecycle Event)
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:24:42 user nova-compute[73208]: INFO nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 16 09:24:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:24:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:24:43 user nova-compute[73208]: INFO nova.compute.manager [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Took 6.77 seconds to build instance.
Aug 16 09:24:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-70376fc2-bf0e-4d86-9f08-50a93ef35d0a tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.888s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a4e4d57-bdb1-401f-8cbe-344ca4643028 req-7f55417e-f21c-4581-b3db-da67dc541b17 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received event network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a4e4d57-bdb1-401f-8cbe-344ca4643028 req-7f55417e-f21c-4581-b3db-da67dc541b17 service nova] Acquiring lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a4e4d57-bdb1-401f-8cbe-344ca4643028 req-7f55417e-f21c-4581-b3db-da67dc541b17 service nova] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a4e4d57-bdb1-401f-8cbe-344ca4643028 req-7f55417e-f21c-4581-b3db-da67dc541b17 service nova] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a4e4d57-bdb1-401f-8cbe-344ca4643028 req-7f55417e-f21c-4581-b3db-da67dc541b17 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] No waiting events found dispatching network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:43 user nova-compute[73208]: WARNING nova.compute.manager [req-9a4e4d57-bdb1-401f-8cbe-344ca4643028 req-7f55417e-f21c-4581-b3db-da67dc541b17 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received unexpected event network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 for instance with vm_state active and task_state None.
Aug 16 09:24:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a4e4d57-bdb1-401f-8cbe-344ca4643028 req-7f55417e-f21c-4581-b3db-da67dc541b17 service nova] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Received event network-vif-deleted-52a7ad9a-8d25-4e56-8341-09d8e5d63f97 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:44 user nova-compute[73208]: INFO nova.compute.manager [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Took 2.49 seconds to detach 3 volumes for instance.
Aug 16 09:24:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:45 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:24:45 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:24:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:45 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Deleted allocations for instance 449e3892-5f7f-41df-828e-75573ad2d8a8
Aug 16 09:24:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-651ce9d0-802c-4610-b975-b5d40a95bf21 tempest-TaggedBootDevicesTest_v242-502411029 tempest-TaggedBootDevicesTest_v242-502411029-project-member] Lock "449e3892-5f7f-41df-828e-75573ad2d8a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.627s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:47 user nova-compute[73208]: INFO nova.compute.manager [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Terminating instance
Aug 16 09:24:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-79d5888a-4678-48ba-8b5b-26ee1056c956 req-ba1ac128-c7ee-423d-b68f-5b5770c63e33 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-unplugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-79d5888a-4678-48ba-8b5b-26ee1056c956 req-ba1ac128-c7ee-423d-b68f-5b5770c63e33 service nova] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-79d5888a-4678-48ba-8b5b-26ee1056c956 req-ba1ac128-c7ee-423d-b68f-5b5770c63e33 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-79d5888a-4678-48ba-8b5b-26ee1056c956 req-ba1ac128-c7ee-423d-b68f-5b5770c63e33 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-79d5888a-4678-48ba-8b5b-26ee1056c956 req-ba1ac128-c7ee-423d-b68f-5b5770c63e33 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] No waiting events found dispatching network-vif-unplugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-79d5888a-4678-48ba-8b5b-26ee1056c956 req-ba1ac128-c7ee-423d-b68f-5b5770c63e33 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-unplugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:24:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Instance destroyed successfully.
Aug 16 09:24:48 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'resources' on Instance uuid 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1569928669',display_name='tempest-ServerActionsTestOtherA-server-1569928669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1569928669',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-sfnlvq70',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=00e2e59e-60e2-4833-8ca1-26a41dad5ea1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "address": "fa:16:3e:fb:90:2c", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bc92838-83", "ovs_interfaceid": "1bc92838-8385-428d-a6cb-ddecf30e8c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_vif [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bc92838-83, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:24:48 user nova-compute[73208]: INFO os_vif [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:90:2c,bridge_name='br-int',has_traffic_filtering=True,id=1bc92838-8385-428d-a6cb-ddecf30e8c2b,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bc92838-83')
Aug 16 09:24:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tESfwzTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:24:48 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f4e725-22a5-4aaf-88cf-53361e24116c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceb5a67-babe-4a4b-a69c-f1ba3e9841b8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:24:48 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:24:48 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:24:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:24:48 user nova-compute[73208]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 (non-flash)
Aug 16 09:24:48 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:24:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d01056c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ae8ecb-4016-46ca-9cb1-72497fb13390]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: True\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3504761-c1d9-4f8d-ab4d-19454ee2c210]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a437e11-7b6a-4139-8a6d-201c7202c90a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea184ea-dae0-4df8-b609-284cfe532947]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf5776c93-7f4139987f1d3c9a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f5776c93', '/dev/disk/by-id/scsi-23766343133393938') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3653b6-f12a-4e66-9380-3aa470399ea3]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1067c3-03a8-4e9a-9094-332e4b2039bc]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3294c34a-468a-49a4-9db6-20d4ce715391]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260]
Aug 16 09:24:48 user nova-compute[73208]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6, portal: 172.16.0.220,3260] successful.
Aug 16 09:24:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81c53afb-aecc-422f-a2cb-332d0dbf6cb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a522e5aa-6740-43f5-ae59-4726c8952e9c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] <== disconnect_volume: return (327ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:24:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Deleting instance files /opt/stack/data/nova/instances/00e2e59e-60e2-4833-8ca1-26a41dad5ea1_del
Aug 16 09:24:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Deletion of /opt/stack/data/nova/instances/00e2e59e-60e2-4833-8ca1-26a41dad5ea1_del complete
Aug 16 09:24:48 user nova-compute[73208]: INFO nova.compute.manager [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 16 09:24:48 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:24:48 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:24:49 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:24:49 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Took 0.83 seconds to deallocate network for instance.
Aug 16 09:24:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-a808d4e4-0b2a-4723-8293-83903cff21c7 req-66433cf2-c0e9-4535-a756-45265a2f8a76 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a808d4e4-0b2a-4723-8293-83903cff21c7 req-66433cf2-c0e9-4535-a756-45265a2f8a76 service nova] Acquiring lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a808d4e4-0b2a-4723-8293-83903cff21c7 req-66433cf2-c0e9-4535-a756-45265a2f8a76 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a808d4e4-0b2a-4723-8293-83903cff21c7 req-66433cf2-c0e9-4535-a756-45265a2f8a76 service nova] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-a808d4e4-0b2a-4723-8293-83903cff21c7 req-66433cf2-c0e9-4535-a756-45265a2f8a76 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] No waiting events found dispatching network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:24:49 user nova-compute[73208]: WARNING nova.compute.manager [req-a808d4e4-0b2a-4723-8293-83903cff21c7 req-66433cf2-c0e9-4535-a756-45265a2f8a76 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received unexpected event network-vif-plugged-1bc92838-8385-428d-a6cb-ddecf30e8c2b for instance with vm_state active and task_state deleting.
Aug 16 09:24:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-a808d4e4-0b2a-4723-8293-83903cff21c7 req-66433cf2-c0e9-4535-a756-45265a2f8a76 service nova] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Received event network-vif-deleted-1bc92838-8385-428d-a6cb-ddecf30e8c2b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:24:50 user nova-compute[73208]: INFO nova.compute.manager [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Took 0.96 seconds to detach 1 volumes for instance.
Aug 16 09:24:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Deleting volume: 81c53afb-aecc-422f-a2cb-332d0dbf6cb6 {{(pid=73208) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 09:24:50 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177875.6337736, 449e3892-5f7f-41df-828e-75573ad2d8a8 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:24:50 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] VM Stopped (Lifecycle Event)
Aug 16 09:24:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c3aa4e67-c5d6-4a63-9afb-4966f07e0818 None None] [instance: 449e3892-5f7f-41df-828e-75573ad2d8a8] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:24:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:24:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:24:50 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:24:50 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:24:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:51 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Deleted allocations for instance 00e2e59e-60e2-4833-8ca1-26a41dad5ea1
Aug 16 09:24:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7f1ab818-2005-4e3f-a1da-3f9905285d5b tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "00e2e59e-60e2-4833-8ca1-26a41dad5ea1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.629s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:24:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:24:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:03 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177888.3452072, 00e2e59e-60e2-4833-8ca1-26a41dad5ea1 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:25:03 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] VM Stopped (Lifecycle Event)
Aug 16 09:25:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-fd9f6ae7-9577-487e-bb6d-77a7d5b2c0d9 None None] [instance: 00e2e59e-60e2-4833-8ca1-26a41dad5ea1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:25:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-5c72d27f-d6fb-4fca-a6d7-41e1f8e1fc48 req-4f4913e3-3023-4ae1-adae-1fefd9370deb service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received event network-changed-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-5c72d27f-d6fb-4fca-a6d7-41e1f8e1fc48 req-4f4913e3-3023-4ae1-adae-1fefd9370deb service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Refreshing instance network info cache due to event network-changed-e7910409-c383-428b-8942-02292d27e33e. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:25:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5c72d27f-d6fb-4fca-a6d7-41e1f8e1fc48 req-4f4913e3-3023-4ae1-adae-1fefd9370deb service nova] Acquiring lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:25:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5c72d27f-d6fb-4fca-a6d7-41e1f8e1fc48 req-4f4913e3-3023-4ae1-adae-1fefd9370deb service nova] Acquired lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:25:03 user nova-compute[73208]: DEBUG nova.network.neutron [req-5c72d27f-d6fb-4fca-a6d7-41e1f8e1fc48 req-4f4913e3-3023-4ae1-adae-1fefd9370deb service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Refreshing network info cache for port e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "85c48f53-33ae-43eb-b5d2-6d44700bed41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:04 user nova-compute[73208]: INFO nova.compute.manager [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Terminating instance
Aug 16 09:25:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:25:04 user nova-compute[73208]: INFO nova.compute.claims [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Claim successful on node user
Aug 16 09:25:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-5c72d27f-d6fb-4fca-a6d7-41e1f8e1fc48 req-4f4913e3-3023-4ae1-adae-1fefd9370deb service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Updated VIF entry in instance network info cache for port e7910409-c383-428b-8942-02292d27e33e. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-5c72d27f-d6fb-4fca-a6d7-41e1f8e1fc48 req-4f4913e3-3023-4ae1-adae-1fefd9370deb service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Updating instance_info_cache with network_info: [{"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5c72d27f-d6fb-4fca-a6d7-41e1f8e1fc48 req-4f4913e3-3023-4ae1-adae-1fefd9370deb service nova] Releasing lock "refresh_cache-85c48f53-33ae-43eb-b5d2-6d44700bed41" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:25:04 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:25:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Instance destroyed successfully.
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.objects.instance [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'resources' on Instance uuid 85c48f53-33ae-43eb-b5d2-6d44700bed41 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-803217606',display_name='tempest-AttachVolumeNegativeTest-server-803217606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-803217606',id=31,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd3NFYn9DMAb7fYl7q0ARwZw5pCY+sl2pOvIzdOO4np+14wHW4loxBuWmOkGOqOsAsRZ2HIZpJsLaal93dgX7ithFoJgVWpLTeyQA/jQG7z4QrNLahPgfHuAoWddAk8gA==',key_name='tempest-keypair-1426766664',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-1fwb7qp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=85c48f53-33ae-43eb-b5d2-6d44700bed41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "e7910409-c383-428b-8942-02292d27e33e", "address": "fa:16:3e:b6:ef:c3", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7910409-c3", "ovs_interfaceid": "e7910409-c383-428b-8942-02292d27e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:c3,bridge_name='br-int',has_traffic_filtering=True,id=e7910409-c383-428b-8942-02292d27e33e,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7910409-c3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG os_vif [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:c3,bridge_name='br-int',has_traffic_filtering=True,id=e7910409-c383-428b-8942-02292d27e33e,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7910409-c3') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7910409-c3, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:25:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:25:05 user nova-compute[73208]: INFO os_vif [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:c3,bridge_name='br-int',has_traffic_filtering=True,id=e7910409-c383-428b-8942-02292d27e33e,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7910409-c3')
Aug 16 09:25:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Deleting instance files /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41_del
Aug 16 09:25:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Deletion of /opt/stack/data/nova/instances/85c48f53-33ae-43eb-b5d2-6d44700bed41_del complete
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.policy [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5e7700a95794faca71c1781b2991241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75db810c942649859c59c7e7eb85b96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:25:05 user nova-compute[73208]: INFO nova.compute.manager [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:25:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Creating image(s)
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "/opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "/opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "/opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk 1073741824" returned: 0 in 0.074s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Successfully created port: 9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.199s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:25:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received event network-vif-unplugged-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] Acquiring lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] No waiting events found dispatching network-vif-unplugged-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received event network-vif-unplugged-e7910409-c383-428b-8942-02292d27e33e for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received event network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] Acquiring lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] No waiting events found dispatching network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:25:06 user nova-compute[73208]: WARNING nova.compute.manager [req-74bd6cdf-d871-4ff0-a3fc-2f4563f1d33c req-0e505147-ab19-4fa2-9621-5466e6f86822 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received unexpected event network-vif-plugged-e7910409-c383-428b-8942-02292d27e33e for instance with vm_state active and task_state deleting.
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Cannot resize image /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'migration_context' on Instance uuid da41698d-660d-47a7-91d9-af48a0f755bf {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Ensure instance console log exists: /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:06 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Took 1.23 seconds to deallocate network for instance.
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-ad4873b3-973f-4023-ae2c-cc8432e6f637 req-3b586f0d-594b-42f9-bbd9-3dff365a5407 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Received event network-vif-deleted-e7910409-c383-428b-8942-02292d27e33e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:06 user nova-compute[73208]: INFO nova.compute.manager [req-ad4873b3-973f-4023-ae2c-cc8432e6f637 req-3b586f0d-594b-42f9-bbd9-3dff365a5407 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Neutron deleted interface e7910409-c383-428b-8942-02292d27e33e; detaching it from the instance and deleting it from the info cache
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.network.neutron [req-ad4873b3-973f-4023-ae2c-cc8432e6f637 req-3b586f0d-594b-42f9-bbd9-3dff365a5407 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-ad4873b3-973f-4023-ae2c-cc8432e6f637 req-3b586f0d-594b-42f9-bbd9-3dff365a5407 service nova] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Detach interface failed, port_id=e7910409-c383-428b-8942-02292d27e33e, reason: Instance 85c48f53-33ae-43eb-b5d2-6d44700bed41 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Successfully updated port: 9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquired lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-01ebb3c6-208b-4281-b54a-199fa55957f1 req-7f029b7e-f0c4-4fd1-b887-fe7bd159fcc3 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received event network-changed-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.manager [req-01ebb3c6-208b-4281-b54a-199fa55957f1 req-7f029b7e-f0c4-4fd1-b887-fe7bd159fcc3 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Refreshing instance network info cache due to event network-changed-9fb108e3-b985-439e-80bb-84990c25449c. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-01ebb3c6-208b-4281-b54a-199fa55957f1 req-7f029b7e-f0c4-4fd1-b887-fe7bd159fcc3 service nova] Acquiring lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:06 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Deleted allocations for instance 85c48f53-33ae-43eb-b5d2-6d44700bed41
Aug 16 09:25:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5cef4d4e-d38e-4eee-bf64-b79654683e79 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "85c48f53-33ae-43eb-b5d2-6d44700bed41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.473s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:06 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Updating instance_info_cache with network_info: [{"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Releasing lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Instance network_info: |[{"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-01ebb3c6-208b-4281-b54a-199fa55957f1 req-7f029b7e-f0c4-4fd1-b887-fe7bd159fcc3 service nova] Acquired lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-01ebb3c6-208b-4281-b54a-199fa55957f1 req-7f029b7e-f0c4-4fd1-b887-fe7bd159fcc3 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Refreshing network info cache for port 9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Start _get_guest_xml network_info=[{"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:25:07 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:25:07 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-639803099',display_name='tempest-VolumesSnapshotTestJSON-instance-639803099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-639803099',id=34,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9MX/arWZTZzseEUOVIforCjIn/IxbxQn+jeRfrrKsxzhMGFAVanyhTo7u5c75Ox3I5DnB1ZralZ0pvZACMskpsXlG3KHJnHxn7sDYHoMcgngr8QXrmFUpBn6VtgWOmVA==',key_name='tempest-keypair-421587495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75db810c942649859c59c7e7eb85b96c',ramdisk_id='',reservation_id='r-aczgy50o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1665109562',owner_user_name='tempest-VolumesSnapshotTestJSON-1665109562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e7700a95794faca71c1781b2991241',uuid=da41698d-660d-47a7-91d9-af48a0f755bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converting VIF {"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:67:eb,bridge_name='br-int',has_traffic_filtering=True,id=9fb108e3-b985-439e-80bb-84990c25449c,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb108e3-b9') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'pci_devices' on Instance uuid da41698d-660d-47a7-91d9-af48a0f755bf {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:25:07 user nova-compute[73208]:   <uuid>da41698d-660d-47a7-91d9-af48a0f755bf</uuid>
Aug 16 09:25:07 user nova-compute[73208]:   <name>instance-00000022</name>
Aug 16 09:25:07 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:25:07 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:25:07 user nova-compute[73208]:   <metadata>
Aug 16 09:25:07 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:25:07 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:25:07 user nova-compute[73208]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-639803099</nova:name>
Aug 16 09:25:07 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:25:07</nova:creationTime>
Aug 16 09:25:07 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:25:07 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:25:07 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:25:07 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:25:07 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:25:07 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:25:07 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:25:07 user nova-compute[73208]:       <nova:owner>
Aug 16 09:25:07 user nova-compute[73208]:         <nova:user uuid="a5e7700a95794faca71c1781b2991241">tempest-VolumesSnapshotTestJSON-1665109562-project-member</nova:user>
Aug 16 09:25:07 user nova-compute[73208]:         <nova:project uuid="75db810c942649859c59c7e7eb85b96c">tempest-VolumesSnapshotTestJSON-1665109562</nova:project>
Aug 16 09:25:07 user nova-compute[73208]:       </nova:owner>
Aug 16 09:25:07 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:25:07 user nova-compute[73208]:       <nova:ports>
Aug 16 09:25:07 user nova-compute[73208]:         <nova:port uuid="9fb108e3-b985-439e-80bb-84990c25449c">
Aug 16 09:25:07 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 09:25:07 user nova-compute[73208]:         </nova:port>
Aug 16 09:25:07 user nova-compute[73208]:       </nova:ports>
Aug 16 09:25:07 user nova-compute[73208]:     </nova:instance>
Aug 16 09:25:07 user nova-compute[73208]:   </metadata>
Aug 16 09:25:07 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:25:07 user nova-compute[73208]:     <system>
Aug 16 09:25:07 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:25:07 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:25:07 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:25:07 user nova-compute[73208]:       <entry name="serial">da41698d-660d-47a7-91d9-af48a0f755bf</entry>
Aug 16 09:25:07 user nova-compute[73208]:       <entry name="uuid">da41698d-660d-47a7-91d9-af48a0f755bf</entry>
Aug 16 09:25:07 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:25:07 user nova-compute[73208]:     </system>
Aug 16 09:25:07 user nova-compute[73208]:   </sysinfo>
Aug 16 09:25:07 user nova-compute[73208]:   <os>
Aug 16 09:25:07 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:25:07 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:25:07 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:25:07 user nova-compute[73208]:   </os>
Aug 16 09:25:07 user nova-compute[73208]:   <features>
Aug 16 09:25:07 user nova-compute[73208]:     <acpi/>
Aug 16 09:25:07 user nova-compute[73208]:     <apic/>
Aug 16 09:25:07 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:25:07 user nova-compute[73208]:   </features>
Aug 16 09:25:07 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:25:07 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:25:07 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:25:07 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:25:07 user nova-compute[73208]:   </clock>
Aug 16 09:25:07 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:25:07 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:25:07 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:25:07 user nova-compute[73208]:   </cpu>
Aug 16 09:25:07 user nova-compute[73208]:   <devices>
Aug 16 09:25:07 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:25:07 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:25:07 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk"/>
Aug 16 09:25:07 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:25:07 user nova-compute[73208]:     </disk>
Aug 16 09:25:07 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:25:07 user nova-compute[73208]:       <mac address="fa:16:3e:dc:67:eb"/>
Aug 16 09:25:07 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:25:07 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:25:07 user nova-compute[73208]:       <target dev="tap9fb108e3-b9"/>
Aug 16 09:25:07 user nova-compute[73208]:     </interface>
Aug 16 09:25:07 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:25:07 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/console.log" append="off"/>
Aug 16 09:25:07 user nova-compute[73208]:     </serial>
Aug 16 09:25:07 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:25:07 user nova-compute[73208]:     <video>
Aug 16 09:25:07 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:25:07 user nova-compute[73208]:     </video>
Aug 16 09:25:07 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:25:07 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:25:07 user nova-compute[73208]:     </rng>
Aug 16 09:25:07 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:25:07 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:25:07 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:25:07 user nova-compute[73208]:     </memballoon>
Aug 16 09:25:07 user nova-compute[73208]:   </devices>
Aug 16 09:25:07 user nova-compute[73208]: </domain>
Aug 16 09:25:07 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-639803099',display_name='tempest-VolumesSnapshotTestJSON-instance-639803099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-639803099',id=34,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9MX/arWZTZzseEUOVIforCjIn/IxbxQn+jeRfrrKsxzhMGFAVanyhTo7u5c75Ox3I5DnB1ZralZ0pvZACMskpsXlG3KHJnHxn7sDYHoMcgngr8QXrmFUpBn6VtgWOmVA==',key_name='tempest-keypair-421587495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75db810c942649859c59c7e7eb85b96c',ramdisk_id='',reservation_id='r-aczgy50o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1665109562',owner_user_name='tempest-VolumesSnapshotTestJSON-1665109562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e7700a95794faca71c1781b2991241',uuid=da41698d-660d-47a7-91d9-af48a0f755bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converting VIF {"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:67:eb,bridge_name='br-int',has_traffic_filtering=True,id=9fb108e3-b985-439e-80bb-84990c25449c,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb108e3-b9') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG os_vif [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:67:eb,bridge_name='br-int',has_traffic_filtering=True,id=9fb108e3-b985-439e-80bb-84990c25449c,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb108e3-b9') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fb108e3-b9, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fb108e3-b9, col_values=(('external_ids', {'iface-id': '9fb108e3-b985-439e-80bb-84990c25449c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:67:eb', 'vm-uuid': 'da41698d-660d-47a7-91d9-af48a0f755bf'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:07 user nova-compute[73208]: INFO os_vif [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:67:eb,bridge_name='br-int',has_traffic_filtering=True,id=9fb108e3-b985-439e-80bb-84990c25449c,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb108e3-b9')
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No VIF found with MAC fa:16:3e:dc:67:eb, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-01ebb3c6-208b-4281-b54a-199fa55957f1 req-7f029b7e-f0c4-4fd1-b887-fe7bd159fcc3 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Updated VIF entry in instance network info cache for port 9fb108e3-b985-439e-80bb-84990c25449c. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-01ebb3c6-208b-4281-b54a-199fa55957f1 req-7f029b7e-f0c4-4fd1-b887-fe7bd159fcc3 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Updating instance_info_cache with network_info: [{"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-01ebb3c6-208b-4281-b54a-199fa55957f1 req-7f029b7e-f0c4-4fd1-b887-fe7bd159fcc3 service nova] Releasing lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:25:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-4013aed1-58e2-4f5d-ba69-ea44f229041f req-529653f6-c68c-474b-b01d-0cc5fbe0fea0 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received event network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4013aed1-58e2-4f5d-ba69-ea44f229041f req-529653f6-c68c-474b-b01d-0cc5fbe0fea0 service nova] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4013aed1-58e2-4f5d-ba69-ea44f229041f req-529653f6-c68c-474b-b01d-0cc5fbe0fea0 service nova] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4013aed1-58e2-4f5d-ba69-ea44f229041f req-529653f6-c68c-474b-b01d-0cc5fbe0fea0 service nova] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-4013aed1-58e2-4f5d-ba69-ea44f229041f req-529653f6-c68c-474b-b01d-0cc5fbe0fea0 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] No waiting events found dispatching network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:25:08 user nova-compute[73208]: WARNING nova.compute.manager [req-4013aed1-58e2-4f5d-ba69-ea44f229041f req-529653f6-c68c-474b-b01d-0cc5fbe0fea0 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received unexpected event network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c for instance with vm_state building and task_state spawning.
Aug 16 09:25:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177910.9147265, da41698d-660d-47a7-91d9-af48a0f755bf => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:25:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] VM Resumed (Lifecycle Event)
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:25:10 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Instance spawned successfully.
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:25:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177910.9150572, da41698d-660d-47a7-91d9-af48a0f755bf => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:25:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] VM Started (Lifecycle Event)
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:25:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:25:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:25:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-aaa6245c-20e6-4ac2-91e6-66fb253aa5da req-1601514b-4093-4216-94e8-bc456fed425a service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received event network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-aaa6245c-20e6-4ac2-91e6-66fb253aa5da req-1601514b-4093-4216-94e8-bc456fed425a service nova] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-aaa6245c-20e6-4ac2-91e6-66fb253aa5da req-1601514b-4093-4216-94e8-bc456fed425a service nova] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-aaa6245c-20e6-4ac2-91e6-66fb253aa5da req-1601514b-4093-4216-94e8-bc456fed425a service nova] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-aaa6245c-20e6-4ac2-91e6-66fb253aa5da req-1601514b-4093-4216-94e8-bc456fed425a service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] No waiting events found dispatching network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:25:11 user nova-compute[73208]: WARNING nova.compute.manager [req-aaa6245c-20e6-4ac2-91e6-66fb253aa5da req-1601514b-4093-4216-94e8-bc456fed425a service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received unexpected event network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c for instance with vm_state building and task_state spawning.
Aug 16 09:25:11 user nova-compute[73208]: INFO nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 16 09:25:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:25:11 user nova-compute[73208]: INFO nova.compute.manager [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Took 6.67 seconds to build instance.
Aug 16 09:25:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3156365b-a7e2-4440-bf3e-020d2a4ae039 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.861s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:20 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177905.0708807, 85c48f53-33ae-43eb-b5d2-6d44700bed41 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:25:20 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] VM Stopped (Lifecycle Event)
Aug 16 09:25:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-aaeafd8b-5baf-44fe-945b-63894267f999 None None] [instance: 85c48f53-33ae-43eb-b5d2-6d44700bed41] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:25:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:25:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:25:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:25:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:25:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:25:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:25:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:25:30 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:25:30 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7795MB free_disk=25.328712463378906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aeff110f-8cbd-480d-8654-b0daee121eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 058f8eb5-1d85-433a-b10c-8b3b255129c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ce7f5083-c390-4418-9e65-5abc231a12fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance da41698d-660d-47a7-91d9-af48a0f755bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-d08d316e-ca2d-4057-8026-f948d2c24f87 req-02b89afa-bec6-476b-80ae-4404de670ce9 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received event network-changed-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-d08d316e-ca2d-4057-8026-f948d2c24f87 req-02b89afa-bec6-476b-80ae-4404de670ce9 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Refreshing instance network info cache due to event network-changed-96fb7389-8d6a-4b62-9057-0977b775e307. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d08d316e-ca2d-4057-8026-f948d2c24f87 req-02b89afa-bec6-476b-80ae-4404de670ce9 service nova] Acquiring lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d08d316e-ca2d-4057-8026-f948d2c24f87 req-02b89afa-bec6-476b-80ae-4404de670ce9 service nova] Acquired lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG nova.network.neutron [req-d08d316e-ca2d-4057-8026-f948d2c24f87 req-02b89afa-bec6-476b-80ae-4404de670ce9 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Refreshing network info cache for port 96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG nova.network.neutron [req-d08d316e-ca2d-4057-8026-f948d2c24f87 req-02b89afa-bec6-476b-80ae-4404de670ce9 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Updated VIF entry in instance network info cache for port 96fb7389-8d6a-4b62-9057-0977b775e307. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG nova.network.neutron [req-d08d316e-ca2d-4057-8026-f948d2c24f87 req-02b89afa-bec6-476b-80ae-4404de670ce9 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Updating instance_info_cache with network_info: [{"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d08d316e-ca2d-4057-8026-f948d2c24f87 req-02b89afa-bec6-476b-80ae-4404de670ce9 service nova] Releasing lock "refresh_cache-c8ad53de-14b1-4358-9dad-da0ea5bed5d1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:25:33 user nova-compute[73208]: INFO nova.compute.manager [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Terminating instance
Aug 16 09:25:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-300df140-19d5-4ec6-85fb-4d4eeeca86cc req-b60754f2-4009-4bed-bdbd-6a960dd3be72 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received event network-vif-unplugged-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-300df140-19d5-4ec6-85fb-4d4eeeca86cc req-b60754f2-4009-4bed-bdbd-6a960dd3be72 service nova] Acquiring lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-300df140-19d5-4ec6-85fb-4d4eeeca86cc req-b60754f2-4009-4bed-bdbd-6a960dd3be72 service nova] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-300df140-19d5-4ec6-85fb-4d4eeeca86cc req-b60754f2-4009-4bed-bdbd-6a960dd3be72 service nova] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-300df140-19d5-4ec6-85fb-4d4eeeca86cc req-b60754f2-4009-4bed-bdbd-6a960dd3be72 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] No waiting events found dispatching network-vif-unplugged-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-300df140-19d5-4ec6-85fb-4d4eeeca86cc req-b60754f2-4009-4bed-bdbd-6a960dd3be72 service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received event network-vif-unplugged-d63ed498-03c0-4216-8146-d0344056aa06 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Instance destroyed successfully.
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.objects.instance [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lazy-loading 'resources' on Instance uuid 058f8eb5-1d85-433a-b10c-8b3b255129c5 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-695212280',display_name='tempest-ServersNegativeTestJSON-server-695212280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-695212280',id=20,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b71b4a11aa5d4e939c88c1e06f14abc0',ramdisk_id='',reservation_id='r-kiok0501',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-678223637',owner_user_name='tempest-ServersNegativeTestJSON-678223637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:16:43Z,user_data=None,user_id='e67935e80e5743359098d8ef555d4f72',uuid=058f8eb5-1d85-433a-b10c-8b3b255129c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converting VIF {"id": "d63ed498-03c0-4216-8146-d0344056aa06", "address": "fa:16:3e:af:8a:4c", "network": {"id": "f3a9c9c6-416d-4853-a161-274c54cd998c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1296906694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71b4a11aa5d4e939c88c1e06f14abc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd63ed498-03", "ovs_interfaceid": "d63ed498-03c0-4216-8146-d0344056aa06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=d63ed498-03c0-4216-8146-d0344056aa06,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd63ed498-03') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG os_vif [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=d63ed498-03c0-4216-8146-d0344056aa06,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd63ed498-03') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd63ed498-03, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:34 user nova-compute[73208]: INFO os_vif [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=d63ed498-03c0-4216-8146-d0344056aa06,network=Network(f3a9c9c6-416d-4853-a161-274c54cd998c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd63ed498-03')
Aug 16 09:25:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Deleting instance files /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5_del
Aug 16 09:25:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Deletion of /opt/stack/data/nova/instances/058f8eb5-1d85-433a-b10c-8b3b255129c5_del complete
Aug 16 09:25:34 user nova-compute[73208]: INFO nova.compute.manager [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 16 09:25:34 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:25:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:35 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Took 0.53 seconds to deallocate network for instance.
Aug 16 09:25:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:35 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Deleted allocations for instance 058f8eb5-1d85-433a-b10c-8b3b255129c5
Aug 16 09:25:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0b32fa33-145a-477a-8052-9e6ef81d08d3 tempest-ServersNegativeTestJSON-678223637 tempest-ServersNegativeTestJSON-678223637-project-member] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.810s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:25:35 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:25:36 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updating instance_info_cache with network_info: [{"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-bd1ee933-a52f-4583-ae40-07c4f8ded92a req-7e8b7d90-2f7f-443c-8cd8-ec960200dc9b service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received event network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bd1ee933-a52f-4583-ae40-07c4f8ded92a req-7e8b7d90-2f7f-443c-8cd8-ec960200dc9b service nova] Acquiring lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bd1ee933-a52f-4583-ae40-07c4f8ded92a req-7e8b7d90-2f7f-443c-8cd8-ec960200dc9b service nova] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bd1ee933-a52f-4583-ae40-07c4f8ded92a req-7e8b7d90-2f7f-443c-8cd8-ec960200dc9b service nova] Lock "058f8eb5-1d85-433a-b10c-8b3b255129c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-bd1ee933-a52f-4583-ae40-07c4f8ded92a req-7e8b7d90-2f7f-443c-8cd8-ec960200dc9b service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] No waiting events found dispatching network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:25:36 user nova-compute[73208]: WARNING nova.compute.manager [req-bd1ee933-a52f-4583-ae40-07c4f8ded92a req-7e8b7d90-2f7f-443c-8cd8-ec960200dc9b service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received unexpected event network-vif-plugged-d63ed498-03c0-4216-8146-d0344056aa06 for instance with vm_state deleted and task_state None.
Aug 16 09:25:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-bd1ee933-a52f-4583-ae40-07c4f8ded92a req-7e8b7d90-2f7f-443c-8cd8-ec960200dc9b service nova] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Received event network-vif-deleted-d63ed498-03c0-4216-8146-d0344056aa06 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:25:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lazy-loading 'flavor' on Instance uuid c8ad53de-14b1-4358-9dad-da0ea5bed5d1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:37 user nova-compute[73208]: INFO nova.compute.manager [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Attaching volume 6c6d3d29-2618-40d5-beb3-52a0f0e72599 to /dev/vdb
Aug 16 09:25:37 user nova-compute[73208]: DEBUG os_brick.utils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedf3d13-5b9d-475d-87bc-8b8662e3f96f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0fa7ca-f00e-496e-b35d-3d4a749e9c91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c79abf-b93c-4f73-bc6e-27a435d8ccdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e8e3ec-50d8-4f2c-b7a7-f5b504a6de04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:25:37 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:25:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecb3285-b02c-4521-8cec-df3dfcb1254d]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG os_brick.utils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:25:37 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Updating existing volume attachment record: f9fe53f1-c511-4bcc-910d-1cd58de0414b {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:25:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:44 user nova-compute[73208]: INFO nova.compute.manager [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Terminating instance
Aug 16 09:25:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-385fda77-25c1-48dc-b0f6-740531bc9fdd req-716310d2-5617-4270-ba83-7ffd461c0bc9 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-vif-unplugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-385fda77-25c1-48dc-b0f6-740531bc9fdd req-716310d2-5617-4270-ba83-7ffd461c0bc9 service nova] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-385fda77-25c1-48dc-b0f6-740531bc9fdd req-716310d2-5617-4270-ba83-7ffd461c0bc9 service nova] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-385fda77-25c1-48dc-b0f6-740531bc9fdd req-716310d2-5617-4270-ba83-7ffd461c0bc9 service nova] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-385fda77-25c1-48dc-b0f6-740531bc9fdd req-716310d2-5617-4270-ba83-7ffd461c0bc9 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] No waiting events found dispatching network-vif-unplugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-385fda77-25c1-48dc-b0f6-740531bc9fdd req-716310d2-5617-4270-ba83-7ffd461c0bc9 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-vif-unplugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:25:45 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Instance destroyed successfully.
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lazy-loading 'resources' on Instance uuid aeff110f-8cbd-480d-8654-b0daee121eb7 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1001827453',display_name='tempest-ServerActionsTestOtherA-server-1001827453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1001827453',id=3,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8VjjXsMXqpLtj4THCuHguYVb5QBc0iBjsO1e6Cz7pbDl6RNrTL21teEKx6cL/XNTNwAaXmf9hT4N7mWP/E49e4+4LCpUzYhH1F/i99Y/Nv6/T/7Sshvp5RLPk0ZpnL4w==',key_name='tempest-keypair-469885765',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62017e5fe324a528f4ad1dc5c939498',ramdisk_id='',reservation_id='r-jdms0qnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1386845270',owner_user_name='tempest-ServerActionsTestOtherA-1386845270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e351e35970aa48028ad400bbda5403b1',uuid=aeff110f-8cbd-480d-8654-b0daee121eb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converting VIF {"id": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "address": "fa:16:3e:b8:2f:51", "network": {"id": "3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1725340969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62017e5fe324a528f4ad1dc5c939498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a69891b-a5", "ovs_interfaceid": "7a69891b-a5ef-4e60-9977-86c0cad59f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:2f:51,bridge_name='br-int',has_traffic_filtering=True,id=7a69891b-a5ef-4e60-9977-86c0cad59f1c,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a69891b-a5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG os_vif [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:2f:51,bridge_name='br-int',has_traffic_filtering=True,id=7a69891b-a5ef-4e60-9977-86c0cad59f1c,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a69891b-a5') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a69891b-a5, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:25:45 user nova-compute[73208]: INFO os_vif [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:2f:51,bridge_name='br-int',has_traffic_filtering=True,id=7a69891b-a5ef-4e60-9977-86c0cad59f1c,network=Network(3a858aec-f89a-4bd2-8aa7-c0ee7fb06d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a69891b-a5')
Aug 16 09:25:45 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Deleting instance files /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7_del
Aug 16 09:25:45 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Deletion of /opt/stack/data/nova/instances/aeff110f-8cbd-480d-8654-b0daee121eb7_del complete
Aug 16 09:25:45 user nova-compute[73208]: INFO nova.compute.manager [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 09:25:45 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:25:45 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:25:46 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:46 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Took 0.56 seconds to deallocate network for instance.
Aug 16 09:25:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-97654029-7673-44d2-8669-ad551317cddd req-2ba65537-1b14-4e3e-bd16-c7ebb75477af service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-vif-deleted-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:46 user nova-compute[73208]: INFO nova.compute.manager [req-97654029-7673-44d2-8669-ad551317cddd req-2ba65537-1b14-4e3e-bd16-c7ebb75477af service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Neutron deleted interface 7a69891b-a5ef-4e60-9977-86c0cad59f1c; detaching it from the instance and deleting it from the info cache
Aug 16 09:25:46 user nova-compute[73208]: DEBUG nova.network.neutron [req-97654029-7673-44d2-8669-ad551317cddd req-2ba65537-1b14-4e3e-bd16-c7ebb75477af service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:25:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-97654029-7673-44d2-8669-ad551317cddd req-2ba65537-1b14-4e3e-bd16-c7ebb75477af service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Detach interface failed, port_id=7a69891b-a5ef-4e60-9977-86c0cad59f1c, reason: Instance aeff110f-8cbd-480d-8654-b0daee121eb7 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:25:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:46 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:25:46 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:25:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:46 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Deleted allocations for instance aeff110f-8cbd-480d-8654-b0daee121eb7
Aug 16 09:25:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c08c0806-d348-436e-876f-f13a81ba9a58 tempest-ServerActionsTestOtherA-1386845270 tempest-ServerActionsTestOtherA-1386845270-project-member] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.885s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-607c455a-649e-40d2-a767-8729ceb22a63 req-b57df062-2d21-4f14-ad7c-2d6b66b06a16 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received event network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:25:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-607c455a-649e-40d2-a767-8729ceb22a63 req-b57df062-2d21-4f14-ad7c-2d6b66b06a16 service nova] Acquiring lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-607c455a-649e-40d2-a767-8729ceb22a63 req-b57df062-2d21-4f14-ad7c-2d6b66b06a16 service nova] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-607c455a-649e-40d2-a767-8729ceb22a63 req-b57df062-2d21-4f14-ad7c-2d6b66b06a16 service nova] Lock "aeff110f-8cbd-480d-8654-b0daee121eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-607c455a-649e-40d2-a767-8729ceb22a63 req-b57df062-2d21-4f14-ad7c-2d6b66b06a16 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] No waiting events found dispatching network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:25:47 user nova-compute[73208]: WARNING nova.compute.manager [req-607c455a-649e-40d2-a767-8729ceb22a63 req-b57df062-2d21-4f14-ad7c-2d6b66b06a16 service nova] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Received unexpected event network-vif-plugged-7a69891b-a5ef-4e60-9977-86c0cad59f1c for instance with vm_state deleted and task_state None.
Aug 16 09:25:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxRshYLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:25:48 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:25:48 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:25:48 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48b60d1-fd39-4ff8-9387-9d1813f20b9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:25:48 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6c2c63-538c-42a0-b59d-f08d4203e55e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599] added
Aug 16 09:25:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c984d-1557-4530-a948-718c970ce25a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c350b6cf-b812-4ede-a89b-854b734ab66e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxRshYLg {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxRshYLg" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0516837e-e1d2-4d48-9d57-511c47a38334]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fxRshYLg'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0617e0-87b7-4869-9a5c-843465715c4a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171e04e-3bfe-48cc-94f1-ef1d37efdee8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:25:48 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:25:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:25:48 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:25:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ce0d84-b1f5-47e7-8057-dde2f4eca738]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599, portal: 172.16.0.220,3260]
Aug 16 09:25:48 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599, portal: 172.16.0.220,3260] successful.
Aug 16 09:25:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bffa536-5c86-4209-a7be-433d5bedba01]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe80fd-258c-48ec-8e62-cea183e76867]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:25:48 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:25:48 user nova-compute[73208]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 (non-flash)
Aug 16 09:25:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:25:48 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:25:48 user nova-compute[73208]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 (non-flash)
Aug 16 09:25:48 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b1893-3d72-485d-9e35-b67db4e90b61]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:25:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxRshYLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177934.42078, 058f8eb5-1d85-433a-b10c-8b3b255129c5 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:25:49 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] VM Stopped (Lifecycle Event)
Aug 16 09:25:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e2daed15-9fe2-4fda-a15d-208786e41dc9 None None] [instance: 058f8eb5-1d85-433a-b10c-8b3b255129c5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26431396662666333', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431396662666333', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lazy-loading 'flavor' on Instance uuid c8ad53de-14b1-4358-9dad-da0ea5bed5d1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:25:49 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:25:49 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:25:49 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:25:49 user nova-compute[73208]:   <serial>6c6d3d29-2618-40d5-beb3-52a0f0e72599</serial>
Aug 16 09:25:49 user nova-compute[73208]: </disk>
Aug 16 09:25:49 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:25:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] No VIF found with MAC fa:16:3e:d0:54:dd, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:25:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a0c48737-6c2f-494d-a3c1-f2289cd0ef1c tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.477s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:51 user nova-compute[73208]: INFO nova.compute.manager [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Detaching volume 6c6d3d29-2618-40d5-beb3-52a0f0e72599
Aug 16 09:25:51 user nova-compute[73208]: INFO nova.virt.block_device [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Attempting to driver detach volume 6c6d3d29-2618-40d5-beb3-52a0f0e72599 from mountpoint /dev/vdb
Aug 16 09:25:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Attempting to detach device vdb from instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:25:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:25:51 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:25:51 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:25:51 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:25:51 user nova-compute[73208]:   <serial>6c6d3d29-2618-40d5-beb3-52a0f0e72599</serial>
Aug 16 09:25:51 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:25:51 user nova-compute[73208]: </disk>
Aug 16 09:25:51 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:25:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Successfully detached device vdb from instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1 from the persistent domain config.
Aug 16 09:25:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:25:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:25:51 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:25:51 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:25:51 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:25:51 user nova-compute[73208]:   <serial>6c6d3d29-2618-40d5-beb3-52a0f0e72599</serial>
Aug 16 09:25:51 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:25:51 user nova-compute[73208]: </disk>
Aug 16 09:25:51 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177952.2558072, c8ad53de-14b1-4358-9dad-da0ea5bed5d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:25:52 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Successfully detached device vdb from instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1 from the live domain config.
Aug 16 09:25:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxRshYLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:25:52 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba246d0-bdd4-4199-b3e1-83612e208190]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ce4a86-3296-4f2b-8266-c24b494e498a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:25:52 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:25:52 user nova-compute[73208]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 (non-flash)
Aug 16 09:25:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:25:52 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:25:52 user nova-compute[73208]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 (non-flash)
Aug 16 09:25:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f01fb520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c265e605-9e72-4576-9f59-4a211066ad6e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6349182b-04cc-4fa3-a933-98a942f38fec]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6234af9-02af-46d6-985e-bfac28deb85c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb269cf7-1573-4c25-845d-8be961f97972]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[894239b5-9d87-4d72-83af-dcab75b44918]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3724a61f-be56-4c02-b33e-d2e24e4ef419]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599, portal: 172.16.0.220,3260]
Aug 16 09:25:52 user nova-compute[73208]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599, portal: 172.16.0.220,3260] successful.
Aug 16 09:25:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6d3d29-2618-40d5-beb3-52a0f0e72599 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[da57adf1-f340-4f11-804d-ba4f9024ab0b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] <== disconnect_volume: return (291ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:25:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:53 user nova-compute[73208]: DEBUG nova.objects.instance [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lazy-loading 'flavor' on Instance uuid c8ad53de-14b1-4358-9dad-da0ea5bed5d1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-edd15370-8e78-4773-a60e-7c9ce5356dd5 tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.923s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:25:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:25:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:25:55 user nova-compute[73208]: INFO nova.compute.manager [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Detaching volume 69caafdb-556b-4c42-bd43-9965ca35ccce
Aug 16 09:25:55 user nova-compute[73208]: INFO nova.virt.block_device [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Attempting to driver detach volume 69caafdb-556b-4c42-bd43-9965ca35ccce from mountpoint /dev/vdb
Aug 16 09:25:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Attempting to detach device vdb from instance ce7f5083-c390-4418-9e65-5abc231a12fc from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:25:56 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:25:56 user nova-compute[73208]:   <source dev="/dev/sdh"/>
Aug 16 09:25:56 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:25:56 user nova-compute[73208]:   <serial>69caafdb-556b-4c42-bd43-9965ca35ccce</serial>
Aug 16 09:25:56 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:25:56 user nova-compute[73208]: </disk>
Aug 16 09:25:56 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:25:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully detached device vdb from instance ce7f5083-c390-4418-9e65-5abc231a12fc from the persistent domain config.
Aug 16 09:25:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce7f5083-c390-4418-9e65-5abc231a12fc from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:25:56 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:25:56 user nova-compute[73208]:   <source dev="/dev/sdh"/>
Aug 16 09:25:56 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:25:56 user nova-compute[73208]:   <serial>69caafdb-556b-4c42-bd43-9965ca35ccce</serial>
Aug 16 09:25:56 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:25:56 user nova-compute[73208]: </disk>
Aug 16 09:25:56 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692177956.44114, ce7f5083-c390-4418-9e65-5abc231a12fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce7f5083-c390-4418-9e65-5abc231a12fc {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:25:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully detached device vdb from instance ce7f5083-c390-4418-9e65-5abc231a12fc from the live domain config.
Aug 16 09:25:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATzIkLwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:25:56 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a581ad7a-a91c-4e94-a386-abaf5c05dad0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e09817-0069-45bf-b861-bef1a4d5036d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:25:56 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:25:56 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:25:56 user nova-compute[73208]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce (non-flash)
Aug 16 09:25:56 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f00a7400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce'): ({'sdh'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Removing single pathed devices sdh {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbb342f-a43b-4014-997f-0c362a8ea95a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad966a2-77db-4036-86bb-969b447516fb]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flushing IO for device /dev/sdh {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b5d572-a6fa-4c01-8283-9dc5e462d4f1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b43d8c-70cc-4ff0-9578-ac9a6331e453]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] SCSI volumes sdh have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7cebaa-1065-4a9e-85e2-8fab79e6fa21]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34cc96b-329d-4ff9-bca8-7621f3b8ab09]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce, portal: 172.16.0.220,3260]
Aug 16 09:25:56 user nova-compute[73208]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce, portal: 172.16.0.220,3260] successful.
Aug 16 09:25:56 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69caafdb-556b-4c42-bd43-9965ca35ccce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9970110-6503-46f1-a08d-1a2f57d910d2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== disconnect_volume: return (263ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:25:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:25:57 user nova-compute[73208]: DEBUG nova.objects.instance [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid ce7f5083-c390-4418-9e65-5abc231a12fc {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:25:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-275789b6-e79b-4f18-b2ac-295d482504fc tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:00 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692177945.549325, aeff110f-8cbd-480d-8654-b0daee121eb7 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:26:00 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] VM Stopped (Lifecycle Event)
Aug 16 09:26:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d7d06ba3-eb82-4e5c-962e-084ff246f16f None None] [instance: aeff110f-8cbd-480d-8654-b0daee121eb7] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:26:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:26:08 user nova-compute[73208]: INFO nova.compute.claims [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Claim successful on node user
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:26:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:26:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Creating image(s)
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG nova.policy [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a31cfa72d13427b896669c9ba5f0832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1964699a248443e68e8ccd09b454c668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk 1073741824" returned: 0 in 0.047s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Successfully created port: 8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Cannot resize image /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG nova.objects.instance [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'migration_context' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Ensure instance console log exists: /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Successfully updated port: 8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquired lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-a5797341-48c8-4a36-abcb-ca075b960373 req-029931b8-5429-4703-b741-5d4e83f4642f service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-changed-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-a5797341-48c8-4a36-abcb-ca075b960373 req-029931b8-5429-4703-b741-5d4e83f4642f service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Refreshing instance network info cache due to event network-changed-8b20c094-a0f7-4c34-a98d-d2938c3ebb28. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a5797341-48c8-4a36-abcb-ca075b960373 req-029931b8-5429-4703-b741-5d4e83f4642f service nova] Acquiring lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.neutron [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Releasing lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance network_info: |[{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a5797341-48c8-4a36-abcb-ca075b960373 req-029931b8-5429-4703-b741-5d4e83f4642f service nova] Acquired lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-a5797341-48c8-4a36-abcb-ca075b960373 req-029931b8-5429-4703-b741-5d4e83f4642f service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Refreshing network info cache for port 8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Start _get_guest_xml network_info=[{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:26:10 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:26:10 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-919633964',display_name='tempest-ServerStableDeviceRescueTest-server-919633964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-919633964',id=35,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0YU4/+Pf8WDx9dx6xIEfPvH/hVAaKk5212Crjq+ypMbUf9I0vNMOG02Jqpqdo7FDE0YgmrXTqjccKYYVYDAQ1JC152XLZ6tzpbdqjRE4VfzMz/CT8MRHCCY2U4P0Lk7g==',key_name='tempest-keypair-835774011',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1964699a248443e68e8ccd09b454c668',ramdisk_id='',reservation_id='r-d674ii0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-513168018',owner_user_name='tempest-ServerStableDeviceRescueTest-513168018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a31cfa72d13427b896669c9ba5f0832',uuid=af45d645-fd93-4e44-9700-018b121659c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Converting VIF {"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:93:22,bridge_name='br-int',has_traffic_filtering=True,id=8b20c094-a0f7-4c34-a98d-d2938c3ebb28,network=Network(ac16d50f-8088-4e9a-87af-e3cddb7e0ce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b20c094-a0') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.objects.instance [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'pci_devices' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:26:10 user nova-compute[73208]:   <uuid>af45d645-fd93-4e44-9700-018b121659c1</uuid>
Aug 16 09:26:10 user nova-compute[73208]:   <name>instance-00000023</name>
Aug 16 09:26:10 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:26:10 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:26:10 user nova-compute[73208]:   <metadata>
Aug 16 09:26:10 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:26:10 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:26:10 user nova-compute[73208]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-919633964</nova:name>
Aug 16 09:26:10 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:26:10</nova:creationTime>
Aug 16 09:26:10 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:26:10 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:26:10 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:26:10 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:26:10 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:26:10 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:26:10 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:26:10 user nova-compute[73208]:       <nova:owner>
Aug 16 09:26:10 user nova-compute[73208]:         <nova:user uuid="5a31cfa72d13427b896669c9ba5f0832">tempest-ServerStableDeviceRescueTest-513168018-project-member</nova:user>
Aug 16 09:26:10 user nova-compute[73208]:         <nova:project uuid="1964699a248443e68e8ccd09b454c668">tempest-ServerStableDeviceRescueTest-513168018</nova:project>
Aug 16 09:26:10 user nova-compute[73208]:       </nova:owner>
Aug 16 09:26:10 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:26:10 user nova-compute[73208]:       <nova:ports>
Aug 16 09:26:10 user nova-compute[73208]:         <nova:port uuid="8b20c094-a0f7-4c34-a98d-d2938c3ebb28">
Aug 16 09:26:10 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 09:26:10 user nova-compute[73208]:         </nova:port>
Aug 16 09:26:10 user nova-compute[73208]:       </nova:ports>
Aug 16 09:26:10 user nova-compute[73208]:     </nova:instance>
Aug 16 09:26:10 user nova-compute[73208]:   </metadata>
Aug 16 09:26:10 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:26:10 user nova-compute[73208]:     <system>
Aug 16 09:26:10 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:26:10 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:26:10 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:26:10 user nova-compute[73208]:       <entry name="serial">af45d645-fd93-4e44-9700-018b121659c1</entry>
Aug 16 09:26:10 user nova-compute[73208]:       <entry name="uuid">af45d645-fd93-4e44-9700-018b121659c1</entry>
Aug 16 09:26:10 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:26:10 user nova-compute[73208]:     </system>
Aug 16 09:26:10 user nova-compute[73208]:   </sysinfo>
Aug 16 09:26:10 user nova-compute[73208]:   <os>
Aug 16 09:26:10 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:26:10 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:26:10 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:26:10 user nova-compute[73208]:   </os>
Aug 16 09:26:10 user nova-compute[73208]:   <features>
Aug 16 09:26:10 user nova-compute[73208]:     <acpi/>
Aug 16 09:26:10 user nova-compute[73208]:     <apic/>
Aug 16 09:26:10 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:26:10 user nova-compute[73208]:   </features>
Aug 16 09:26:10 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:26:10 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:26:10 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:26:10 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:26:10 user nova-compute[73208]:   </clock>
Aug 16 09:26:10 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:26:10 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:26:10 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:26:10 user nova-compute[73208]:   </cpu>
Aug 16 09:26:10 user nova-compute[73208]:   <devices>
Aug 16 09:26:10 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:26:10 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:26:10 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk"/>
Aug 16 09:26:10 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:26:10 user nova-compute[73208]:     </disk>
Aug 16 09:26:10 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:26:10 user nova-compute[73208]:       <mac address="fa:16:3e:13:93:22"/>
Aug 16 09:26:10 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:26:10 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:26:10 user nova-compute[73208]:       <target dev="tap8b20c094-a0"/>
Aug 16 09:26:10 user nova-compute[73208]:     </interface>
Aug 16 09:26:10 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:26:10 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/console.log" append="off"/>
Aug 16 09:26:10 user nova-compute[73208]:     </serial>
Aug 16 09:26:10 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:26:10 user nova-compute[73208]:     <video>
Aug 16 09:26:10 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:26:10 user nova-compute[73208]:     </video>
Aug 16 09:26:10 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:26:10 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:26:10 user nova-compute[73208]:     </rng>
Aug 16 09:26:10 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:26:10 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:26:10 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:26:10 user nova-compute[73208]:     </memballoon>
Aug 16 09:26:10 user nova-compute[73208]:   </devices>
Aug 16 09:26:10 user nova-compute[73208]: </domain>
Aug 16 09:26:10 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-919633964',display_name='tempest-ServerStableDeviceRescueTest-server-919633964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-919633964',id=35,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0YU4/+Pf8WDx9dx6xIEfPvH/hVAaKk5212Crjq+ypMbUf9I0vNMOG02Jqpqdo7FDE0YgmrXTqjccKYYVYDAQ1JC152XLZ6tzpbdqjRE4VfzMz/CT8MRHCCY2U4P0Lk7g==',key_name='tempest-keypair-835774011',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1964699a248443e68e8ccd09b454c668',ramdisk_id='',reservation_id='r-d674ii0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-513168018',owner_user_name='tempest-ServerStableDeviceRescueTest-513168018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a31cfa72d13427b896669c9ba5f0832',uuid=af45d645-fd93-4e44-9700-018b121659c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Converting VIF {"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:93:22,bridge_name='br-int',has_traffic_filtering=True,id=8b20c094-a0f7-4c34-a98d-d2938c3ebb28,network=Network(ac16d50f-8088-4e9a-87af-e3cddb7e0ce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b20c094-a0') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG os_vif [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:93:22,bridge_name='br-int',has_traffic_filtering=True,id=8b20c094-a0f7-4c34-a98d-d2938c3ebb28,network=Network(ac16d50f-8088-4e9a-87af-e3cddb7e0ce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b20c094-a0') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b20c094-a0, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b20c094-a0, col_values=(('external_ids', {'iface-id': '8b20c094-a0f7-4c34-a98d-d2938c3ebb28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:93:22', 'vm-uuid': 'af45d645-fd93-4e44-9700-018b121659c1'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:10 user nova-compute[73208]: INFO os_vif [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:93:22,bridge_name='br-int',has_traffic_filtering=True,id=8b20c094-a0f7-4c34-a98d-d2938c3ebb28,network=Network(ac16d50f-8088-4e9a-87af-e3cddb7e0ce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b20c094-a0')
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No VIF found with MAC fa:16:3e:13:93:22, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-a5797341-48c8-4a36-abcb-ca075b960373 req-029931b8-5429-4703-b741-5d4e83f4642f service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updated VIF entry in instance network info cache for port 8b20c094-a0f7-4c34-a98d-d2938c3ebb28. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-a5797341-48c8-4a36-abcb-ca075b960373 req-029931b8-5429-4703-b741-5d4e83f4642f service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:26:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a5797341-48c8-4a36-abcb-ca075b960373 req-029931b8-5429-4703-b741-5d4e83f4642f service nova] Releasing lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:26:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-e3f74c4a-2000-44d8-a171-72a5e188d0a7 req-98942c7d-7209-4787-a0c5-4c3914c7fa7e service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e3f74c4a-2000-44d8-a171-72a5e188d0a7 req-98942c7d-7209-4787-a0c5-4c3914c7fa7e service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e3f74c4a-2000-44d8-a171-72a5e188d0a7 req-98942c7d-7209-4787-a0c5-4c3914c7fa7e service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e3f74c4a-2000-44d8-a171-72a5e188d0a7 req-98942c7d-7209-4787-a0c5-4c3914c7fa7e service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-e3f74c4a-2000-44d8-a171-72a5e188d0a7 req-98942c7d-7209-4787-a0c5-4c3914c7fa7e service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:26:12 user nova-compute[73208]: WARNING nova.compute.manager [req-e3f74c4a-2000-44d8-a171-72a5e188d0a7 req-98942c7d-7209-4787-a0c5-4c3914c7fa7e service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state building and task_state spawning.
Aug 16 09:26:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177974.0968604, af45d645-fd93-4e44-9700-018b121659c1 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:26:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] VM Resumed (Lifecycle Event)
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:26:14 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance spawned successfully.
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:26:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692177974.1001344, af45d645-fd93-4e44-9700-018b121659c1 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:26:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] VM Started (Lifecycle Event)
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:26:14 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:26:14 user nova-compute[73208]: INFO nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:26:14 user nova-compute[73208]: INFO nova.compute.manager [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Took 6.23 seconds to build instance.
Aug 16 09:26:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-5e6455af-c7e7-45a5-8ace-d9c858432f25 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.321s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-98a75cd5-233f-4b9d-b438-aaefb6936c81 req-0aa855ff-7777-452c-af01-eaa2844131da service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-98a75cd5-233f-4b9d-b438-aaefb6936c81 req-0aa855ff-7777-452c-af01-eaa2844131da service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-98a75cd5-233f-4b9d-b438-aaefb6936c81 req-0aa855ff-7777-452c-af01-eaa2844131da service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-98a75cd5-233f-4b9d-b438-aaefb6936c81 req-0aa855ff-7777-452c-af01-eaa2844131da service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-98a75cd5-233f-4b9d-b438-aaefb6936c81 req-0aa855ff-7777-452c-af01-eaa2844131da service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:26:14 user nova-compute[73208]: WARNING nova.compute.manager [req-98a75cd5-233f-4b9d-b438-aaefb6936c81 req-0aa855ff-7777-452c-af01-eaa2844131da service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state active and task_state None.
Aug 16 09:26:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:26 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:26 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:26:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:26:27 user nova-compute[73208]: INFO nova.compute.manager [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] instance snapshotting
Aug 16 09:26:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Beginning live snapshot process
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json -f qcow2 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json -f qcow2 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdkajldg2/8263f1c58036413bba7c6f67524d8093.delta 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdkajldg2/8263f1c58036413bba7c6f67524d8093.delta 1073741824" returned: 0 in 0.050s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:26:29 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdkajldg2/8263f1c58036413bba7c6f67524d8093.delta /opt/stack/data/nova/instances/snapshots/tmpdkajldg2/8263f1c58036413bba7c6f67524d8093 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdkajldg2/8263f1c58036413bba7c6f67524d8093.delta /opt/stack/data/nova/instances/snapshots/tmpdkajldg2/8263f1c58036413bba7c6f67524d8093" returned: 0 in 0.808s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Snapshot extracted, beginning image upload
Aug 16 09:26:30 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:26:30 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7902MB free_disk=25.363975524902344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance ce7f5083-c390-4418-9e65-5abc231a12fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance da41698d-660d-47a7-91d9-af48a0f755bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance af45d645-fd93-4e44-9700-018b121659c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:26:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:31 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:26:32 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Snapshot image upload complete
Aug 16 09:26:33 user nova-compute[73208]: INFO nova.compute.manager [None req-0475027b-db06-406e-99df-e951799071d1 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Took 5.52 seconds to snapshot the instance on the hypervisor.
Aug 16 09:26:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:37 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:26:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:26:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:26:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:26:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:26:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updating instance_info_cache with network_info: [{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:26:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:26:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:26:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:46 user nova-compute[73208]: INFO nova.compute.manager [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Terminating instance
Aug 16 09:26:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-012d0e8c-2f1f-4723-840a-09d88f330c81 req-6d55b056-8f63-411a-87a6-e217b898c55f service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received event network-vif-unplugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-012d0e8c-2f1f-4723-840a-09d88f330c81 req-6d55b056-8f63-411a-87a6-e217b898c55f service nova] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-012d0e8c-2f1f-4723-840a-09d88f330c81 req-6d55b056-8f63-411a-87a6-e217b898c55f service nova] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-012d0e8c-2f1f-4723-840a-09d88f330c81 req-6d55b056-8f63-411a-87a6-e217b898c55f service nova] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-012d0e8c-2f1f-4723-840a-09d88f330c81 req-6d55b056-8f63-411a-87a6-e217b898c55f service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] No waiting events found dispatching network-vif-unplugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:26:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-012d0e8c-2f1f-4723-840a-09d88f330c81 req-6d55b056-8f63-411a-87a6-e217b898c55f service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received event network-vif-unplugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Instance destroyed successfully.
Aug 16 09:26:47 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'resources' on Instance uuid ce7f5083-c390-4418-9e65-5abc231a12fc {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2025661843',display_name='tempest-AttachVolumeNegativeTest-server-2025661843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2025661843',id=29,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0nVPsu6kLI4GOq5/5QeVZEH7rEOoya5tI81bsTJRr5VU5UFL/thOwn3L60wTFc8ZD0clweReqGJ9eYDeJSHwSNJv/DtRCSSJ0wBvN0pkQzcCCcrOz0wuruoWOZkZQZLA==',key_name='tempest-keypair-1925335469',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-xug0dp5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=ce7f5083-c390-4418-9e65-5abc231a12fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "address": "fa:16:3e:ff:22:dc", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bb4dbc-e4", "ovs_interfaceid": "52bb4dbc-e48d-42dc-a0c7-facb91fd42bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:22:dc,bridge_name='br-int',has_traffic_filtering=True,id=52bb4dbc-e48d-42dc-a0c7-facb91fd42bd,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bb4dbc-e4') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG os_vif [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:22:dc,bridge_name='br-int',has_traffic_filtering=True,id=52bb4dbc-e48d-42dc-a0c7-facb91fd42bd,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bb4dbc-e4') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52bb4dbc-e4, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:26:47 user nova-compute[73208]: INFO os_vif [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:22:dc,bridge_name='br-int',has_traffic_filtering=True,id=52bb4dbc-e48d-42dc-a0c7-facb91fd42bd,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bb4dbc-e4')
Aug 16 09:26:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Deleting instance files /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc_del
Aug 16 09:26:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Deletion of /opt/stack/data/nova/instances/ce7f5083-c390-4418-9e65-5abc231a12fc_del complete
Aug 16 09:26:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 09:26:47 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:26:47 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:26:48 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Took 1.17 seconds to deallocate network for instance.
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:48 user nova-compute[73208]: INFO nova.compute.manager [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Terminating instance
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-8fc24783-39ab-4ed0-b05d-3608cc1c107e req-72847185-8b43-4ba7-8dbb-7bf10301ad93 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received event network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8fc24783-39ab-4ed0-b05d-3608cc1c107e req-72847185-8b43-4ba7-8dbb-7bf10301ad93 service nova] Acquiring lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8fc24783-39ab-4ed0-b05d-3608cc1c107e req-72847185-8b43-4ba7-8dbb-7bf10301ad93 service nova] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8fc24783-39ab-4ed0-b05d-3608cc1c107e req-72847185-8b43-4ba7-8dbb-7bf10301ad93 service nova] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-8fc24783-39ab-4ed0-b05d-3608cc1c107e req-72847185-8b43-4ba7-8dbb-7bf10301ad93 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] No waiting events found dispatching network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:26:48 user nova-compute[73208]: WARNING nova.compute.manager [req-8fc24783-39ab-4ed0-b05d-3608cc1c107e req-72847185-8b43-4ba7-8dbb-7bf10301ad93 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received unexpected event network-vif-plugged-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd for instance with vm_state deleted and task_state None.
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-8fc24783-39ab-4ed0-b05d-3608cc1c107e req-72847185-8b43-4ba7-8dbb-7bf10301ad93 service nova] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Received event network-vif-deleted-52bb4dbc-e48d-42dc-a0c7-facb91fd42bd {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:48 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Deleted allocations for instance ce7f5083-c390-4418-9e65-5abc231a12fc
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-659c7ab4-bb6f-4d41-99d0-ca8e08f812d1 req-4a57a09f-690d-46f0-93d2-d6e2e858cead service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received event network-vif-unplugged-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-659c7ab4-bb6f-4d41-99d0-ca8e08f812d1 req-4a57a09f-690d-46f0-93d2-d6e2e858cead service nova] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-659c7ab4-bb6f-4d41-99d0-ca8e08f812d1 req-4a57a09f-690d-46f0-93d2-d6e2e858cead service nova] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-659c7ab4-bb6f-4d41-99d0-ca8e08f812d1 req-4a57a09f-690d-46f0-93d2-d6e2e858cead service nova] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-659c7ab4-bb6f-4d41-99d0-ca8e08f812d1 req-4a57a09f-690d-46f0-93d2-d6e2e858cead service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] No waiting events found dispatching network-vif-unplugged-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-659c7ab4-bb6f-4d41-99d0-ca8e08f812d1 req-4a57a09f-690d-46f0-93d2-d6e2e858cead service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received event network-vif-unplugged-96fb7389-8d6a-4b62-9057-0977b775e307 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:26:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f7469160-166f-41c0-83da-344d63943825 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "ce7f5083-c390-4418-9e65-5abc231a12fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Instance destroyed successfully.
Aug 16 09:26:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lazy-loading 'resources' on Instance uuid c8ad53de-14b1-4358-9dad-da0ea5bed5d1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-611427825',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-611427825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6114278',id=32,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5/2u+QYNIZ0j00iJaPUYLX/pCntNC4+U66Z0/+JiVagNJ/CJrfmoAF3uJwhTJnmHWyaZrQKbi7oZHxIKa2ejaqWnTf1QzK2FPcYhK93lKj7Wojf7KXxT0/7BUydV5tiQ==',key_name='tempest-keypair-366517279',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c6253d83a854c2599f96025ffb8cf26',ramdisk_id='',reservation_id='r-bqwkzitu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151097611',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c2938a42c1a48f9aaf08f9b11580521',uuid=c8ad53de-14b1-4358-9dad-da0ea5bed5d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Converting VIF {"id": "96fb7389-8d6a-4b62-9057-0977b775e307", "address": "fa:16:3e:d0:54:dd", "network": {"id": "841c4cf0-e2d6-462f-8e0b-8cf2a90680f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109433009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c6253d83a854c2599f96025ffb8cf26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fb7389-8d", "ovs_interfaceid": "96fb7389-8d6a-4b62-9057-0977b775e307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=96fb7389-8d6a-4b62-9057-0977b775e307,network=Network(841c4cf0-e2d6-462f-8e0b-8cf2a90680f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fb7389-8d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG os_vif [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=96fb7389-8d6a-4b62-9057-0977b775e307,network=Network(841c4cf0-e2d6-462f-8e0b-8cf2a90680f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fb7389-8d') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96fb7389-8d, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:26:49 user nova-compute[73208]: INFO os_vif [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=96fb7389-8d6a-4b62-9057-0977b775e307,network=Network(841c4cf0-e2d6-462f-8e0b-8cf2a90680f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fb7389-8d')
Aug 16 09:26:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Deleting instance files /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1_del
Aug 16 09:26:49 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Deletion of /opt/stack/data/nova/instances/c8ad53de-14b1-4358-9dad-da0ea5bed5d1_del complete
Aug 16 09:26:49 user nova-compute[73208]: INFO nova.compute.manager [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 09:26:49 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:26:49 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:26:50 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Took 1.06 seconds to deallocate network for instance.
Aug 16 09:26:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-784d2283-4b67-4b96-898b-c85df9f8069a req-0881e795-de44-4013-b807-c272d5125353 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received event network-vif-deleted-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:50 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Deleted allocations for instance c8ad53de-14b1-4358-9dad-da0ea5bed5d1
Aug 16 09:26:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-daeaba5f-57f3-4a24-9d4c-9b3010571300 req-f5f2e78b-fe1a-4464-916b-b2279137d472 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received event network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-daeaba5f-57f3-4a24-9d4c-9b3010571300 req-f5f2e78b-fe1a-4464-916b-b2279137d472 service nova] Acquiring lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-daeaba5f-57f3-4a24-9d4c-9b3010571300 req-f5f2e78b-fe1a-4464-916b-b2279137d472 service nova] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-daeaba5f-57f3-4a24-9d4c-9b3010571300 req-f5f2e78b-fe1a-4464-916b-b2279137d472 service nova] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-daeaba5f-57f3-4a24-9d4c-9b3010571300 req-f5f2e78b-fe1a-4464-916b-b2279137d472 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] No waiting events found dispatching network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:26:50 user nova-compute[73208]: WARNING nova.compute.manager [req-daeaba5f-57f3-4a24-9d4c-9b3010571300 req-f5f2e78b-fe1a-4464-916b-b2279137d472 service nova] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Received unexpected event network-vif-plugged-96fb7389-8d6a-4b62-9057-0977b775e307 for instance with vm_state deleted and task_state None.
Aug 16 09:26:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c2436ba-836e-4796-ae7b-f80e4862074a tempest-TestServerVolumeAttachScenarioOldVersion-151097611 tempest-TestServerVolumeAttachScenarioOldVersion-151097611-project-member] Lock "c8ad53de-14b1-4358-9dad-da0ea5bed5d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:26:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-966a8a5c-6efc-4359-8e57-210fc5bc9644 req-4a012939-6c62-4152-95c6-bfde929a3bba service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received event network-changed-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:26:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-966a8a5c-6efc-4359-8e57-210fc5bc9644 req-4a012939-6c62-4152-95c6-bfde929a3bba service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Refreshing instance network info cache due to event network-changed-9fb108e3-b985-439e-80bb-84990c25449c. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:26:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-966a8a5c-6efc-4359-8e57-210fc5bc9644 req-4a012939-6c62-4152-95c6-bfde929a3bba service nova] Acquiring lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:26:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-966a8a5c-6efc-4359-8e57-210fc5bc9644 req-4a012939-6c62-4152-95c6-bfde929a3bba service nova] Acquired lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:26:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-966a8a5c-6efc-4359-8e57-210fc5bc9644 req-4a012939-6c62-4152-95c6-bfde929a3bba service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Refreshing network info cache for port 9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:26:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-966a8a5c-6efc-4359-8e57-210fc5bc9644 req-4a012939-6c62-4152-95c6-bfde929a3bba service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Updated VIF entry in instance network info cache for port 9fb108e3-b985-439e-80bb-84990c25449c. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:26:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-966a8a5c-6efc-4359-8e57-210fc5bc9644 req-4a012939-6c62-4152-95c6-bfde929a3bba service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Updating instance_info_cache with network_info: [{"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:26:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-966a8a5c-6efc-4359-8e57-210fc5bc9644 req-4a012939-6c62-4152-95c6-bfde929a3bba service nova] Releasing lock "refresh_cache-da41698d-660d-47a7-91d9-af48a0f755bf" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG nova.objects.instance [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'flavor' on Instance uuid da41698d-660d-47a7-91d9-af48a0f755bf {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:26:57 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Ignoring supplied device name: /dev/vdb
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:26:57 user nova-compute[73208]: INFO nova.compute.manager [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Attaching volume a0cc6299-b238-4c7f-aab9-93ff4e2faf4a to /dev/vdb
Aug 16 09:26:57 user nova-compute[73208]: DEBUG os_brick.utils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[53315dc9-e9e6-4797-9189-8b64e85027ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ab0f04-cc88-48a3-8e6d-94584f2a8935]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f735bd-fc60-4c65-978c-15d460ae3c9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5569343a-af4a-4083-8b92-ac828e5ae083]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:26:57 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:26:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[859a3844-fc02-473c-be5b-5fae6923f45f]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG os_brick.utils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:26:57 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Updating existing volume attachment record: e11b4f3c-11a0-4168-a33d-31a0e8d55e5a {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:26:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:27:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:02 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178007.1047938, ce7f5083-c390-4418-9e65-5abc231a12fc => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:27:02 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] VM Stopped (Lifecycle Event)
Aug 16 09:27:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-691b2812-ad24-46ec-ba0e-1ac180a3b40d None None] [instance: ce7f5083-c390-4418-9e65-5abc231a12fc] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:27:04 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178009.3214135, c8ad53de-14b1-4358-9dad-da0ea5bed5d1 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:27:04 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] VM Stopped (Lifecycle Event)
Aug 16 09:27:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:04 user nova-compute[73208]: DEBUG nova.compute.manager [None req-eadbddd3-9359-46c7-8f64-7f41f1ec79e2 None None] [instance: c8ad53de-14b1-4358-9dad-da0ea5bed5d1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:27:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMCBNmvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:27:08 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:27:08 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:27:08 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a701de-db33-423a-ac21-710fd3ef9bd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:27:08 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcba5aec-d9d2-4a9b-9905-d79034a3349d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a] added
Aug 16 09:27:08 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa20301-e925-4f35-b9e8-ece0a02d9db2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ec76b4-d337-4096-8ee0-cab1401675a3]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FMCBNmvo {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FMCBNmvo" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[949303b7-ce33-420d-b966-989169a16b6b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FMCBNmvo'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0103cb86-864b-43ea-9212-c4266cedefe8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93ee89a-51e5-40e1-abda-aa96e1857e9f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:08 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:08 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e18d4ad-172c-4a3f-ab56-a1c44561de9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a, portal: 172.16.0.220,3260]
Aug 16 09:27:08 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a, portal: 172.16.0.220,3260] successful.
Aug 16 09:27:08 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2147725-d135-4f08-8744-ef499c651573]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[04291b54-652f-4b88-9bdb-d7f9d35e6644]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:08 user nova-compute[73208]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a (non-flash)
Aug 16 09:27:08 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:08 user nova-compute[73208]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a (non-flash)
Aug 16 09:27:08 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[50540f66-5c35-4e8d-a76b-654d939ec5f3]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:08 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMCBNmvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23638653735326439', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638653735326439', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG nova.objects.instance [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'flavor' on Instance uuid da41698d-660d-47a7-91d9-af48a0f755bf {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:27:09 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:27:09 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:27:09 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:27:09 user nova-compute[73208]:   <serial>a0cc6299-b238-4c7f-aab9-93ff4e2faf4a</serial>
Aug 16 09:27:09 user nova-compute[73208]: </disk>
Aug 16 09:27:09 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:27:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] No VIF found with MAC fa:16:3e:dc:67:eb, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:27:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-feb1a5b8-183d-4ab2-ba81-efd7aa6f548c tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.637s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:27:18 user nova-compute[73208]: INFO nova.compute.claims [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Claim successful on node user
Aug 16 09:27:18 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:18 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:27:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:27:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG nova.policy [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cc24a14b3af4b1da397e15e2eb24b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f192344e7d44f28f954625aea2d9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:27:19 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Creating image(s)
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "/opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "/opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk 1073741824" returned: 0 in 0.061s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:19 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Successfully created port: c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Cannot resize image /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.objects.instance [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lazy-loading 'migration_context' on Instance uuid 3b0705d8-5d30-4eb8-9fb3-80383add75b9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Ensure instance console log exists: /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Successfully updated port: c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "refresh_cache-3b0705d8-5d30-4eb8-9fb3-80383add75b9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquired lock "refresh_cache-3b0705d8-5d30-4eb8-9fb3-80383add75b9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-d919382e-042c-4012-9c94-c1953506741e req-46cca1ad-7451-451f-b987-38387b152843 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received event network-changed-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-d919382e-042c-4012-9c94-c1953506741e req-46cca1ad-7451-451f-b987-38387b152843 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Refreshing instance network info cache due to event network-changed-c8a8ea9f-f5ea-427d-9ffd-6385494871b2. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d919382e-042c-4012-9c94-c1953506741e req-46cca1ad-7451-451f-b987-38387b152843 service nova] Acquiring lock "refresh_cache-3b0705d8-5d30-4eb8-9fb3-80383add75b9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:27:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Updating instance_info_cache with network_info: [{"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Releasing lock "refresh_cache-3b0705d8-5d30-4eb8-9fb3-80383add75b9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Instance network_info: |[{"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d919382e-042c-4012-9c94-c1953506741e req-46cca1ad-7451-451f-b987-38387b152843 service nova] Acquired lock "refresh_cache-3b0705d8-5d30-4eb8-9fb3-80383add75b9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.network.neutron [req-d919382e-042c-4012-9c94-c1953506741e req-46cca1ad-7451-451f-b987-38387b152843 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Refreshing network info cache for port c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Start _get_guest_xml network_info=[{"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:27:21 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:27:21 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-959534735',display_name='tempest-VolumesActionsTest-instance-959534735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-959534735',id=36,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f192344e7d44f28f954625aea2d9d4',ramdisk_id='',reservation_id='r-bnii8my1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1328217380',owner_user_name='tempest-VolumesActionsTest-1328217380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:27:19Z,user_data=None,user_id='7cc24a14b3af4b1da397e15e2eb24b6a',uuid=3b0705d8-5d30-4eb8-9fb3-80383add75b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Converting VIF {"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:31:42,bridge_name='br-int',has_traffic_filtering=True,id=c8a8ea9f-f5ea-427d-9ffd-6385494871b2,network=Network(17a98ca3-287d-48cf-b872-689576e6e9af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a8ea9f-f5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.objects.instance [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b0705d8-5d30-4eb8-9fb3-80383add75b9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:27:21 user nova-compute[73208]:   <uuid>3b0705d8-5d30-4eb8-9fb3-80383add75b9</uuid>
Aug 16 09:27:21 user nova-compute[73208]:   <name>instance-00000024</name>
Aug 16 09:27:21 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:27:21 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:27:21 user nova-compute[73208]:   <metadata>
Aug 16 09:27:21 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:27:21 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:27:21 user nova-compute[73208]:       <nova:name>tempest-VolumesActionsTest-instance-959534735</nova:name>
Aug 16 09:27:21 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:27:21</nova:creationTime>
Aug 16 09:27:21 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:27:21 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:27:21 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:27:21 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:27:21 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:27:21 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:27:21 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:27:21 user nova-compute[73208]:       <nova:owner>
Aug 16 09:27:21 user nova-compute[73208]:         <nova:user uuid="7cc24a14b3af4b1da397e15e2eb24b6a">tempest-VolumesActionsTest-1328217380-project-member</nova:user>
Aug 16 09:27:21 user nova-compute[73208]:         <nova:project uuid="b4f192344e7d44f28f954625aea2d9d4">tempest-VolumesActionsTest-1328217380</nova:project>
Aug 16 09:27:21 user nova-compute[73208]:       </nova:owner>
Aug 16 09:27:21 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:27:21 user nova-compute[73208]:       <nova:ports>
Aug 16 09:27:21 user nova-compute[73208]:         <nova:port uuid="c8a8ea9f-f5ea-427d-9ffd-6385494871b2">
Aug 16 09:27:21 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:27:21 user nova-compute[73208]:         </nova:port>
Aug 16 09:27:21 user nova-compute[73208]:       </nova:ports>
Aug 16 09:27:21 user nova-compute[73208]:     </nova:instance>
Aug 16 09:27:21 user nova-compute[73208]:   </metadata>
Aug 16 09:27:21 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:27:21 user nova-compute[73208]:     <system>
Aug 16 09:27:21 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:27:21 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:27:21 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:27:21 user nova-compute[73208]:       <entry name="serial">3b0705d8-5d30-4eb8-9fb3-80383add75b9</entry>
Aug 16 09:27:21 user nova-compute[73208]:       <entry name="uuid">3b0705d8-5d30-4eb8-9fb3-80383add75b9</entry>
Aug 16 09:27:21 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:27:21 user nova-compute[73208]:     </system>
Aug 16 09:27:21 user nova-compute[73208]:   </sysinfo>
Aug 16 09:27:21 user nova-compute[73208]:   <os>
Aug 16 09:27:21 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:27:21 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:27:21 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:27:21 user nova-compute[73208]:   </os>
Aug 16 09:27:21 user nova-compute[73208]:   <features>
Aug 16 09:27:21 user nova-compute[73208]:     <acpi/>
Aug 16 09:27:21 user nova-compute[73208]:     <apic/>
Aug 16 09:27:21 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:27:21 user nova-compute[73208]:   </features>
Aug 16 09:27:21 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:27:21 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:27:21 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:27:21 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:27:21 user nova-compute[73208]:   </clock>
Aug 16 09:27:21 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:27:21 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:27:21 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:27:21 user nova-compute[73208]:   </cpu>
Aug 16 09:27:21 user nova-compute[73208]:   <devices>
Aug 16 09:27:21 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:27:21 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:27:21 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk"/>
Aug 16 09:27:21 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:27:21 user nova-compute[73208]:     </disk>
Aug 16 09:27:21 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:27:21 user nova-compute[73208]:       <mac address="fa:16:3e:c9:31:42"/>
Aug 16 09:27:21 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:27:21 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:27:21 user nova-compute[73208]:       <target dev="tapc8a8ea9f-f5"/>
Aug 16 09:27:21 user nova-compute[73208]:     </interface>
Aug 16 09:27:21 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:27:21 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/console.log" append="off"/>
Aug 16 09:27:21 user nova-compute[73208]:     </serial>
Aug 16 09:27:21 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:27:21 user nova-compute[73208]:     <video>
Aug 16 09:27:21 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:27:21 user nova-compute[73208]:     </video>
Aug 16 09:27:21 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:27:21 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:27:21 user nova-compute[73208]:     </rng>
Aug 16 09:27:21 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:27:21 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:27:21 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:27:21 user nova-compute[73208]:     </memballoon>
Aug 16 09:27:21 user nova-compute[73208]:   </devices>
Aug 16 09:27:21 user nova-compute[73208]: </domain>
Aug 16 09:27:21 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-959534735',display_name='tempest-VolumesActionsTest-instance-959534735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-959534735',id=36,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f192344e7d44f28f954625aea2d9d4',ramdisk_id='',reservation_id='r-bnii8my1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1328217380',owner_user_name='tempest-VolumesActionsTest-1328217380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:27:19Z,user_data=None,user_id='7cc24a14b3af4b1da397e15e2eb24b6a',uuid=3b0705d8-5d30-4eb8-9fb3-80383add75b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Converting VIF {"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:31:42,bridge_name='br-int',has_traffic_filtering=True,id=c8a8ea9f-f5ea-427d-9ffd-6385494871b2,network=Network(17a98ca3-287d-48cf-b872-689576e6e9af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a8ea9f-f5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG os_vif [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:31:42,bridge_name='br-int',has_traffic_filtering=True,id=c8a8ea9f-f5ea-427d-9ffd-6385494871b2,network=Network(17a98ca3-287d-48cf-b872-689576e6e9af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a8ea9f-f5') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8a8ea9f-f5, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8a8ea9f-f5, col_values=(('external_ids', {'iface-id': 'c8a8ea9f-f5ea-427d-9ffd-6385494871b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:31:42', 'vm-uuid': '3b0705d8-5d30-4eb8-9fb3-80383add75b9'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:21 user nova-compute[73208]: INFO os_vif [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:31:42,bridge_name='br-int',has_traffic_filtering=True,id=c8a8ea9f-f5ea-427d-9ffd-6385494871b2,network=Network(17a98ca3-287d-48cf-b872-689576e6e9af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a8ea9f-f5')
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] No VIF found with MAC fa:16:3e:c9:31:42, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.network.neutron [req-d919382e-042c-4012-9c94-c1953506741e req-46cca1ad-7451-451f-b987-38387b152843 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Updated VIF entry in instance network info cache for port c8a8ea9f-f5ea-427d-9ffd-6385494871b2. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG nova.network.neutron [req-d919382e-042c-4012-9c94-c1953506741e req-46cca1ad-7451-451f-b987-38387b152843 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Updating instance_info_cache with network_info: [{"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:27:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d919382e-042c-4012-9c94-c1953506741e req-46cca1ad-7451-451f-b987-38387b152843 service nova] Releasing lock "refresh_cache-3b0705d8-5d30-4eb8-9fb3-80383add75b9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:27:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-476391b1-cb8b-4209-9f95-559739c66956 req-ae667f34-5acc-4381-892a-a634e56ae427 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received event network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-476391b1-cb8b-4209-9f95-559739c66956 req-ae667f34-5acc-4381-892a-a634e56ae427 service nova] Acquiring lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-476391b1-cb8b-4209-9f95-559739c66956 req-ae667f34-5acc-4381-892a-a634e56ae427 service nova] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-476391b1-cb8b-4209-9f95-559739c66956 req-ae667f34-5acc-4381-892a-a634e56ae427 service nova] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-476391b1-cb8b-4209-9f95-559739c66956 req-ae667f34-5acc-4381-892a-a634e56ae427 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] No waiting events found dispatching network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:27:22 user nova-compute[73208]: WARNING nova.compute.manager [req-476391b1-cb8b-4209-9f95-559739c66956 req-ae667f34-5acc-4381-892a-a634e56ae427 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received unexpected event network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 for instance with vm_state building and task_state spawning.
Aug 16 09:27:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178044.8799663, 3b0705d8-5d30-4eb8-9fb3-80383add75b9 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:27:24 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] VM Resumed (Lifecycle Event)
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:27:24 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Instance spawned successfully.
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:24 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178044.8845346, 3b0705d8-5d30-4eb8-9fb3-80383add75b9 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:27:24 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] VM Started (Lifecycle Event)
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:27:24 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:27:24 user nova-compute[73208]: INFO nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 16 09:27:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:27:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-ddf4fa49-001a-434d-a190-1493b9f20b84 req-78dbeac3-3a83-4be9-9912-cef91f580c8a service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received event network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ddf4fa49-001a-434d-a190-1493b9f20b84 req-78dbeac3-3a83-4be9-9912-cef91f580c8a service nova] Acquiring lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ddf4fa49-001a-434d-a190-1493b9f20b84 req-78dbeac3-3a83-4be9-9912-cef91f580c8a service nova] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ddf4fa49-001a-434d-a190-1493b9f20b84 req-78dbeac3-3a83-4be9-9912-cef91f580c8a service nova] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-ddf4fa49-001a-434d-a190-1493b9f20b84 req-78dbeac3-3a83-4be9-9912-cef91f580c8a service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] No waiting events found dispatching network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:27:25 user nova-compute[73208]: WARNING nova.compute.manager [req-ddf4fa49-001a-434d-a190-1493b9f20b84 req-78dbeac3-3a83-4be9-9912-cef91f580c8a service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received unexpected event network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 for instance with vm_state building and task_state spawning.
Aug 16 09:27:25 user nova-compute[73208]: INFO nova.compute.manager [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Took 6.52 seconds to build instance.
Aug 16 09:27:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-af5e7764-44f5-4942-8aa8-08734fc2f0da tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.613s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:27 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:28 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:28 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:27:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:27:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:31 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:27:31 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=25.32793426513672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance da41698d-660d-47a7-91d9-af48a0f755bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance af45d645-fd93-4e44-9700-018b121659c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 3b0705d8-5d30-4eb8-9fb3-80383add75b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:27:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:27:35 user nova-compute[73208]: INFO nova.compute.claims [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Claim successful on node user
Aug 16 09:27:35 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:27:35 user nova-compute[73208]: DEBUG nova.network.neutron [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:27:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:27:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:27:35 user nova-compute[73208]: INFO nova.virt.block_device [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Booting with volume-backed-image 57e619ae-e236-4dcb-9810-c1a72d3e5cd4 at /dev/vda
Aug 16 09:27:36 user nova-compute[73208]: DEBUG nova.policy [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91255b4dbf814537906275122738afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da0d7fd51c4dcaba48f74dc423e684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:27:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:36 user nova-compute[73208]: DEBUG nova.network.neutron [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Successfully created port: c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Successfully updated port: c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquired lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-2225e075-130a-489d-a354-1298080086b5 req-bb8a8ec0-d86f-4558-80fa-7bf6c566dd05 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-changed-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-2225e075-130a-489d-a354-1298080086b5 req-bb8a8ec0-d86f-4558-80fa-7bf6c566dd05 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Refreshing instance network info cache due to event network-changed-c2285ef4-64f2-42cf-8995-04bc6ce4258c. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:27:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2225e075-130a-489d-a354-1298080086b5 req-bb8a8ec0-d86f-4558-80fa-7bf6c566dd05 service nova] Acquiring lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:27:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updating instance_info_cache with network_info: [{"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:27:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Releasing lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:27:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance network_info: |[{"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:27:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2225e075-130a-489d-a354-1298080086b5 req-bb8a8ec0-d86f-4558-80fa-7bf6c566dd05 service nova] Acquired lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:27:38 user nova-compute[73208]: DEBUG nova.network.neutron [req-2225e075-130a-489d-a354-1298080086b5 req-bb8a8ec0-d86f-4558-80fa-7bf6c566dd05 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Refreshing network info cache for port c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:27:38 user nova-compute[73208]: DEBUG nova.network.neutron [req-2225e075-130a-489d-a354-1298080086b5 req-bb8a8ec0-d86f-4558-80fa-7bf6c566dd05 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updated VIF entry in instance network info cache for port c2285ef4-64f2-42cf-8995-04bc6ce4258c. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:27:38 user nova-compute[73208]: DEBUG nova.network.neutron [req-2225e075-130a-489d-a354-1298080086b5 req-bb8a8ec0-d86f-4558-80fa-7bf6c566dd05 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updating instance_info_cache with network_info: [{"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:27:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2225e075-130a-489d-a354-1298080086b5 req-bb8a8ec0-d86f-4558-80fa-7bf6c566dd05 service nova] Releasing lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:27:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "f62bba74-2ef0-46f4-adee-7695e2379018" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:27:41 user nova-compute[73208]: INFO nova.compute.claims [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Claim successful on node user
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:27:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.policy [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18737770cdee43d6a782ebbbd311e8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12301729e76a42afa0c8923d3d428cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:27:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Creating image(s)
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "/opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "/opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "/opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.215s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk 1073741824" returned: 0 in 0.055s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Cannot resize image /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG nova.objects.instance [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'migration_context' on Instance uuid f62bba74-2ef0-46f4-adee-7695e2379018 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Ensure instance console log exists: /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Successfully created port: 8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:27:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Successfully updated port: 8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:27:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:27:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquired lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:27:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:27:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e7de1e2-a4f7-4e5e-b2a9-46e4149f27f7 req-0559f24a-49ca-4556-be93-9bcfeca66344 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Received event network-changed-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e7de1e2-a4f7-4e5e-b2a9-46e4149f27f7 req-0559f24a-49ca-4556-be93-9bcfeca66344 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Refreshing instance network info cache due to event network-changed-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:27:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e7de1e2-a4f7-4e5e-b2a9-46e4149f27f7 req-0559f24a-49ca-4556-be93-9bcfeca66344 service nova] Acquiring lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:27:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Updating instance_info_cache with network_info: [{"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Releasing lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Instance network_info: |[{"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e7de1e2-a4f7-4e5e-b2a9-46e4149f27f7 req-0559f24a-49ca-4556-be93-9bcfeca66344 service nova] Acquired lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-0e7de1e2-a4f7-4e5e-b2a9-46e4149f27f7 req-0559f24a-49ca-4556-be93-9bcfeca66344 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Refreshing network info cache for port 8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Start _get_guest_xml network_info=[{"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:27:44 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:27:44 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48433274',display_name='tempest-AttachVolumeNegativeTest-server-48433274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48433274',id=38,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZDwz4szeX4201J5weat99xGwdsm3qfIiNdV188dRQl55qR6sskJ3mSV+gorCNTiUYe78XGuYW5t5UWRl6xle2m+3OesEfgI27mheK84ak3u8HtcesrowPpa8KVvPYDrA==',key_name='tempest-keypair-517959847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-nwexhqz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:27:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=f62bba74-2ef0-46f4-adee-7695e2379018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:08:41,bridge_name='br-int',has_traffic_filtering=True,id=8300e258-72cb-4f0a-bc99-99f0f3a0dfc3,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8300e258-72') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'pci_devices' on Instance uuid f62bba74-2ef0-46f4-adee-7695e2379018 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:27:44 user nova-compute[73208]:   <uuid>f62bba74-2ef0-46f4-adee-7695e2379018</uuid>
Aug 16 09:27:44 user nova-compute[73208]:   <name>instance-00000026</name>
Aug 16 09:27:44 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:27:44 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:27:44 user nova-compute[73208]:   <metadata>
Aug 16 09:27:44 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:27:44 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:27:44 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeNegativeTest-server-48433274</nova:name>
Aug 16 09:27:44 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:27:44</nova:creationTime>
Aug 16 09:27:44 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:27:44 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:27:44 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:27:44 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:27:44 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:27:44 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:27:44 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:27:44 user nova-compute[73208]:       <nova:owner>
Aug 16 09:27:44 user nova-compute[73208]:         <nova:user uuid="18737770cdee43d6a782ebbbd311e8fc">tempest-AttachVolumeNegativeTest-657236303-project-member</nova:user>
Aug 16 09:27:44 user nova-compute[73208]:         <nova:project uuid="12301729e76a42afa0c8923d3d428cac">tempest-AttachVolumeNegativeTest-657236303</nova:project>
Aug 16 09:27:44 user nova-compute[73208]:       </nova:owner>
Aug 16 09:27:44 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:27:44 user nova-compute[73208]:       <nova:ports>
Aug 16 09:27:44 user nova-compute[73208]:         <nova:port uuid="8300e258-72cb-4f0a-bc99-99f0f3a0dfc3">
Aug 16 09:27:44 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 09:27:44 user nova-compute[73208]:         </nova:port>
Aug 16 09:27:44 user nova-compute[73208]:       </nova:ports>
Aug 16 09:27:44 user nova-compute[73208]:     </nova:instance>
Aug 16 09:27:44 user nova-compute[73208]:   </metadata>
Aug 16 09:27:44 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:27:44 user nova-compute[73208]:     <system>
Aug 16 09:27:44 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:27:44 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:27:44 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:27:44 user nova-compute[73208]:       <entry name="serial">f62bba74-2ef0-46f4-adee-7695e2379018</entry>
Aug 16 09:27:44 user nova-compute[73208]:       <entry name="uuid">f62bba74-2ef0-46f4-adee-7695e2379018</entry>
Aug 16 09:27:44 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:27:44 user nova-compute[73208]:     </system>
Aug 16 09:27:44 user nova-compute[73208]:   </sysinfo>
Aug 16 09:27:44 user nova-compute[73208]:   <os>
Aug 16 09:27:44 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:27:44 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:27:44 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:27:44 user nova-compute[73208]:   </os>
Aug 16 09:27:44 user nova-compute[73208]:   <features>
Aug 16 09:27:44 user nova-compute[73208]:     <acpi/>
Aug 16 09:27:44 user nova-compute[73208]:     <apic/>
Aug 16 09:27:44 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:27:44 user nova-compute[73208]:   </features>
Aug 16 09:27:44 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:27:44 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:27:44 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:27:44 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:27:44 user nova-compute[73208]:   </clock>
Aug 16 09:27:44 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:27:44 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:27:44 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:27:44 user nova-compute[73208]:   </cpu>
Aug 16 09:27:44 user nova-compute[73208]:   <devices>
Aug 16 09:27:44 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:27:44 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:27:44 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk"/>
Aug 16 09:27:44 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:27:44 user nova-compute[73208]:     </disk>
Aug 16 09:27:44 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:27:44 user nova-compute[73208]:       <mac address="fa:16:3e:dc:08:41"/>
Aug 16 09:27:44 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:27:44 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:27:44 user nova-compute[73208]:       <target dev="tap8300e258-72"/>
Aug 16 09:27:44 user nova-compute[73208]:     </interface>
Aug 16 09:27:44 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:27:44 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/console.log" append="off"/>
Aug 16 09:27:44 user nova-compute[73208]:     </serial>
Aug 16 09:27:44 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:27:44 user nova-compute[73208]:     <video>
Aug 16 09:27:44 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:27:44 user nova-compute[73208]:     </video>
Aug 16 09:27:44 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:27:44 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:27:44 user nova-compute[73208]:     </rng>
Aug 16 09:27:44 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:27:44 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:27:44 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:27:44 user nova-compute[73208]:     </memballoon>
Aug 16 09:27:44 user nova-compute[73208]:   </devices>
Aug 16 09:27:44 user nova-compute[73208]: </domain>
Aug 16 09:27:44 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48433274',display_name='tempest-AttachVolumeNegativeTest-server-48433274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48433274',id=38,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZDwz4szeX4201J5weat99xGwdsm3qfIiNdV188dRQl55qR6sskJ3mSV+gorCNTiUYe78XGuYW5t5UWRl6xle2m+3OesEfgI27mheK84ak3u8HtcesrowPpa8KVvPYDrA==',key_name='tempest-keypair-517959847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-nwexhqz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:27:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=f62bba74-2ef0-46f4-adee-7695e2379018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:08:41,bridge_name='br-int',has_traffic_filtering=True,id=8300e258-72cb-4f0a-bc99-99f0f3a0dfc3,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8300e258-72') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG os_vif [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:08:41,bridge_name='br-int',has_traffic_filtering=True,id=8300e258-72cb-4f0a-bc99-99f0f3a0dfc3,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8300e258-72') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8300e258-72, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8300e258-72, col_values=(('external_ids', {'iface-id': '8300e258-72cb-4f0a-bc99-99f0f3a0dfc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:08:41', 'vm-uuid': 'f62bba74-2ef0-46f4-adee-7695e2379018'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:44 user nova-compute[73208]: INFO os_vif [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:08:41,bridge_name='br-int',has_traffic_filtering=True,id=8300e258-72cb-4f0a-bc99-99f0f3a0dfc3,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8300e258-72')
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No VIF found with MAC fa:16:3e:dc:08:41, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:44 user nova-compute[73208]: INFO nova.compute.manager [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Detaching volume a0cc6299-b238-4c7f-aab9-93ff4e2faf4a
Aug 16 09:27:44 user nova-compute[73208]: INFO nova.virt.block_device [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Attempting to driver detach volume a0cc6299-b238-4c7f-aab9-93ff4e2faf4a from mountpoint /dev/vdb
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Attempting to detach device vdb from instance da41698d-660d-47a7-91d9-af48a0f755bf from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:27:44 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:27:44 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:27:44 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:27:44 user nova-compute[73208]:   <serial>a0cc6299-b238-4c7f-aab9-93ff4e2faf4a</serial>
Aug 16 09:27:44 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:27:44 user nova-compute[73208]: </disk>
Aug 16 09:27:44 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:44 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Successfully detached device vdb from instance da41698d-660d-47a7-91d9-af48a0f755bf from the persistent domain config.
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da41698d-660d-47a7-91d9-af48a0f755bf from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:27:44 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:27:44 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:27:44 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:27:44 user nova-compute[73208]:   <serial>a0cc6299-b238-4c7f-aab9-93ff4e2faf4a</serial>
Aug 16 09:27:44 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:27:44 user nova-compute[73208]: </disk>
Aug 16 09:27:44 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-0e7de1e2-a4f7-4e5e-b2a9-46e4149f27f7 req-0559f24a-49ca-4556-be93-9bcfeca66344 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Updated VIF entry in instance network info cache for port 8300e258-72cb-4f0a-bc99-99f0f3a0dfc3. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-0e7de1e2-a4f7-4e5e-b2a9-46e4149f27f7 req-0559f24a-49ca-4556-be93-9bcfeca66344 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Updating instance_info_cache with network_info: [{"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:27:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e7de1e2-a4f7-4e5e-b2a9-46e4149f27f7 req-0559f24a-49ca-4556-be93-9bcfeca66344 service nova] Releasing lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178065.449852, da41698d-660d-47a7-91d9-af48a0f755bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da41698d-660d-47a7-91d9-af48a0f755bf {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:27:45 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Successfully detached device vdb from instance da41698d-660d-47a7-91d9-af48a0f755bf from the live domain config.
Aug 16 09:27:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMCBNmvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:27:45 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[155bbc85-2fcb-4b18-849c-bdea334e541b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[90110522-5daa-42c7-a550-cd96c42c0b29]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:45 user nova-compute[73208]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a (non-flash)
Aug 16 09:27:45 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:45 user nova-compute[73208]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a (non-flash)
Aug 16 09:27:45 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d022fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383f0b1-b6f8-4ca5-b1fd-844bf4b606aa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bd438d-3561-4bf6-bc1e-0f4c7451da8c]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad6eed7-fe84-40a6-b2ed-413c9f9dddc2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c51e3e-f92d-4572-bba9-598bf88900ae]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc152e7-e122-4bd3-bee5-67984e3f36fc]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c8aeb-4645-423e-9d45-8d2fecef33ca]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a, portal: 172.16.0.220,3260]
Aug 16 09:27:45 user nova-compute[73208]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a, portal: 172.16.0.220,3260] successful.
Aug 16 09:27:45 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aede3acf-ae86-461b-987b-d9cd9a2d62e7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] <== disconnect_volume: return (285ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:27:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-4f78837d-efda-4d5d-b69a-584e3e7f0543 req-4eac3a18-a24b-4f5c-b12c-97b6668c2c38 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Received event network-vif-plugged-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4f78837d-efda-4d5d-b69a-584e3e7f0543 req-4eac3a18-a24b-4f5c-b12c-97b6668c2c38 service nova] Acquiring lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4f78837d-efda-4d5d-b69a-584e3e7f0543 req-4eac3a18-a24b-4f5c-b12c-97b6668c2c38 service nova] Lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4f78837d-efda-4d5d-b69a-584e3e7f0543 req-4eac3a18-a24b-4f5c-b12c-97b6668c2c38 service nova] Lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG nova.compute.manager [req-4f78837d-efda-4d5d-b69a-584e3e7f0543 req-4eac3a18-a24b-4f5c-b12c-97b6668c2c38 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] No waiting events found dispatching network-vif-plugged-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:27:46 user nova-compute[73208]: WARNING nova.compute.manager [req-4f78837d-efda-4d5d-b69a-584e3e7f0543 req-4eac3a18-a24b-4f5c-b12c-97b6668c2c38 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Received unexpected event network-vif-plugged-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 for instance with vm_state building and task_state spawning.
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'flavor' on Instance uuid da41698d-660d-47a7-91d9-af48a0f755bf {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b0af22a0-c76b-46af-bf44-0596f56ffc04 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.153s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.039s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:46 user nova-compute[73208]: INFO nova.compute.manager [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Terminating instance
Aug 16 09:27:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG os_brick.utils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a29f9ce-0310-4119-b398-7e9526c0f316]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7111db5e-53d3-4c36-8aa9-833423fdb94e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09015ab-42b0-4ff3-a8dd-6b8021293a4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[569aad42-ee43-48d9-980b-6ccf6f227526]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:27:47 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a604133d-ee03-41fa-bc09-3ba2ba52844b]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.utils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updating existing volume attachment record: ab2eed66-5a40-4fff-8f0f-c6a1e3771a22 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-e57ea3dc-0514-4f6e-a49e-94c22327db58 req-34464d0e-b0a0-4286-85b9-9c56db09c536 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received event network-vif-unplugged-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e57ea3dc-0514-4f6e-a49e-94c22327db58 req-34464d0e-b0a0-4286-85b9-9c56db09c536 service nova] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e57ea3dc-0514-4f6e-a49e-94c22327db58 req-34464d0e-b0a0-4286-85b9-9c56db09c536 service nova] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e57ea3dc-0514-4f6e-a49e-94c22327db58 req-34464d0e-b0a0-4286-85b9-9c56db09c536 service nova] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-e57ea3dc-0514-4f6e-a49e-94c22327db58 req-34464d0e-b0a0-4286-85b9-9c56db09c536 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] No waiting events found dispatching network-vif-unplugged-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-e57ea3dc-0514-4f6e-a49e-94c22327db58 req-34464d0e-b0a0-4286-85b9-9c56db09c536 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received event network-vif-unplugged-9fb108e3-b985-439e-80bb-84990c25449c for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Instance destroyed successfully.
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.objects.instance [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lazy-loading 'resources' on Instance uuid da41698d-660d-47a7-91d9-af48a0f755bf {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-639803099',display_name='tempest-VolumesSnapshotTestJSON-instance-639803099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-639803099',id=34,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9MX/arWZTZzseEUOVIforCjIn/IxbxQn+jeRfrrKsxzhMGFAVanyhTo7u5c75Ox3I5DnB1ZralZ0pvZACMskpsXlG3KHJnHxn7sDYHoMcgngr8QXrmFUpBn6VtgWOmVA==',key_name='tempest-keypair-421587495',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:25:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75db810c942649859c59c7e7eb85b96c',ramdisk_id='',reservation_id='r-aczgy50o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1665109562',owner_user_name='tempest-VolumesSnapshotTestJSON-1665109562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e7700a95794faca71c1781b2991241',uuid=da41698d-660d-47a7-91d9-af48a0f755bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converting VIF {"id": "9fb108e3-b985-439e-80bb-84990c25449c", "address": "fa:16:3e:dc:67:eb", "network": {"id": "30bb59db-ab0b-4e61-b2a0-e4bf314d5260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-51192959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75db810c942649859c59c7e7eb85b96c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb108e3-b9", "ovs_interfaceid": "9fb108e3-b985-439e-80bb-84990c25449c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:67:eb,bridge_name='br-int',has_traffic_filtering=True,id=9fb108e3-b985-439e-80bb-84990c25449c,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb108e3-b9') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_vif [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:67:eb,bridge_name='br-int',has_traffic_filtering=True,id=9fb108e3-b985-439e-80bb-84990c25449c,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb108e3-b9') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fb108e3-b9, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:27:47 user nova-compute[73208]: INFO os_vif [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:67:eb,bridge_name='br-int',has_traffic_filtering=True,id=9fb108e3-b985-439e-80bb-84990c25449c,network=Network(30bb59db-ab0b-4e61-b2a0-e4bf314d5260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb108e3-b9')
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMCBNmvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:27:47 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0cc6299-b238-4c7f-aab9-93ff4e2faf4a', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cbb564-25b0-4d2c-9aa9-aad5d72358dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c64d5-57e9-4c7f-92ec-be9ec7dea79c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0244ee0>, {}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Disconnecting from: [] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] <== disconnect_volume: return (48ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:27:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Deleting instance files /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf_del
Aug 16 09:27:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Deletion of /opt/stack/data/nova/instances/da41698d-660d-47a7-91d9-af48a0f755bf_del complete
Aug 16 09:27:47 user nova-compute[73208]: INFO nova.compute.manager [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 09:27:47 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:27:47 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178068.5630918, f62bba74-2ef0-46f4-adee-7695e2379018 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] VM Resumed (Lifecycle Event)
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Instance spawned successfully.
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178068.5671062, f62bba74-2ef0-46f4-adee-7695e2379018 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] VM Started (Lifecycle Event)
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-67a0cd29-5da4-4c7a-a495-371e72265aa3 req-4cbe4458-98c6-413c-8270-5768964e9d9e service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Received event network-vif-plugged-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-67a0cd29-5da4-4c7a-a495-371e72265aa3 req-4cbe4458-98c6-413c-8270-5768964e9d9e service nova] Acquiring lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-67a0cd29-5da4-4c7a-a495-371e72265aa3 req-4cbe4458-98c6-413c-8270-5768964e9d9e service nova] Lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-67a0cd29-5da4-4c7a-a495-371e72265aa3 req-4cbe4458-98c6-413c-8270-5768964e9d9e service nova] Lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-67a0cd29-5da4-4c7a-a495-371e72265aa3 req-4cbe4458-98c6-413c-8270-5768964e9d9e service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] No waiting events found dispatching network-vif-plugged-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:27:48 user nova-compute[73208]: WARNING nova.compute.manager [req-67a0cd29-5da4-4c7a-a495-371e72265aa3 req-4cbe4458-98c6-413c-8270-5768964e9d9e service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Received unexpected event network-vif-plugged-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 for instance with vm_state building and task_state spawning.
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-87d92fa8-7cd5-4bcd-a926-8bfb2676fddc req-83a68c93-39af-457a-b7a6-5dd63358ba7b service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received event network-vif-deleted-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [req-87d92fa8-7cd5-4bcd-a926-8bfb2676fddc req-83a68c93-39af-457a-b7a6-5dd63358ba7b service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Neutron deleted interface 9fb108e3-b985-439e-80bb-84990c25449c; detaching it from the instance and deleting it from the info cache
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-87d92fa8-7cd5-4bcd-a926-8bfb2676fddc req-83a68c93-39af-457a-b7a6-5dd63358ba7b service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Took 1.07 seconds to deallocate network for instance.
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-87d92fa8-7cd5-4bcd-a926-8bfb2676fddc req-83a68c93-39af-457a-b7a6-5dd63358ba7b service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Detach interface failed, port_id=9fb108e3-b985-439e-80bb-84990c25449c, reason: Instance da41698d-660d-47a7-91d9-af48a0f755bf could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 16 09:27:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:27:48 user nova-compute[73208]: WARNING nova.volume.cinder [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Attachment e11b4f3c-11a0-4168-a33d-31a0e8d55e5a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e11b4f3c-11a0-4168-a33d-31a0e8d55e5a. (HTTP 404) (Request-ID: req-f0de147d-39e2-4db0-986c-0a628e220f7e)
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Took 0.05 seconds to detach 1 volumes for instance.
Aug 16 09:27:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:48 user nova-compute[73208]: INFO nova.compute.manager [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Took 7.89 seconds to build instance.
Aug 16 09:27:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-358cd314-bb92-466a-806a-1807168dbda6 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.988s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:49 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:27:49 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:27:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:49 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Deleted allocations for instance da41698d-660d-47a7-91d9-af48a0f755bf
Aug 16 09:27:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-8dbafa95-52e8-4a81-8baa-285d65212691 req-02a2fc92-28d5-4c8d-96e6-65806ddbd3d7 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received event network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8dbafa95-52e8-4a81-8baa-285d65212691 req-02a2fc92-28d5-4c8d-96e6-65806ddbd3d7 service nova] Acquiring lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8dbafa95-52e8-4a81-8baa-285d65212691 req-02a2fc92-28d5-4c8d-96e6-65806ddbd3d7 service nova] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8dbafa95-52e8-4a81-8baa-285d65212691 req-02a2fc92-28d5-4c8d-96e6-65806ddbd3d7 service nova] Lock "da41698d-660d-47a7-91d9-af48a0f755bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-8dbafa95-52e8-4a81-8baa-285d65212691 req-02a2fc92-28d5-4c8d-96e6-65806ddbd3d7 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] No waiting events found dispatching network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:27:49 user nova-compute[73208]: WARNING nova.compute.manager [req-8dbafa95-52e8-4a81-8baa-285d65212691 req-02a2fc92-28d5-4c8d-96e6-65806ddbd3d7 service nova] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Received unexpected event network-vif-plugged-9fb108e3-b985-439e-80bb-84990c25449c for instance with vm_state deleted and task_state None.
Aug 16 09:27:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cd8023af-7b22-476f-aed3-0c08603e34f7 tempest-VolumesSnapshotTestJSON-1665109562 tempest-VolumesSnapshotTestJSON-1665109562-project-member] Lock "da41698d-660d-47a7-91d9-af48a0f755bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.644s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:27:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:27:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:27:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:27:57 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Creating image(s)
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Ensure instance console log exists: /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Start _get_guest_xml network_info=[{"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'ab2eed66-5a40-4fff-8f0f-c6a1e3771a22', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLUZldBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abbf98e1-d609-49ab-8b7f-6b8d57f2718a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b36ffde6-8ea6-4113-b957-24b45608e9c4', 'serial': 'b36ffde6-8ea6-4113-b957-24b45608e9c4'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:27:57 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:27:57 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLUZldBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:27:57 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:27:57 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:27:57 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1590c6-ae59-461c-abf6-a5849b8c7dd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:27:57 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[640fe2f2-44f0-4647-9bbb-8468df81c522]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4] added
Aug 16 09:27:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ae7abc-8d48-488d-a0a0-f14a1f5a91f9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fed2f3-4695-44f5-bad4-2d664dc06715]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLUZldBw {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLUZldBw" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c9d3cc-911f-4f82-8106-d237e50bb68a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLUZldBw'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70ae17e-61d2-47a6-b483-5f900d88bab7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3355beb-4ced-4768-aa9c-19624471b3ca]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:58 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:58 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c39c062-4e94-43a6-bd43-8e31d67a8ddc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4, portal: 172.16.0.220,3260]
Aug 16 09:27:58 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4, portal: 172.16.0.220,3260] successful.
Aug 16 09:27:58 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d3d38f-9156-40df-bb9b-b2f2628e341e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea58f19-6d44-46b1-82a5-b6e382f5f3b6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:58 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:27:58 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:27:58 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:27:58 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[49871e90-d45b-4303-ac25-e9764b0c3ae5]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:27:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLUZldBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23538613765636635', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538613765636635', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-297253768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-297253768',id=37,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-04qko1jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:27:36Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=abbf98e1-d609-49ab-8b7f-6b8d57f2718a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=c2285ef4-64f2-42cf-8995-04bc6ce4258c,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2285ef4-64') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.objects.instance [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'pci_devices' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:27:59 user nova-compute[73208]:   <uuid>abbf98e1-d609-49ab-8b7f-6b8d57f2718a</uuid>
Aug 16 09:27:59 user nova-compute[73208]:   <name>instance-00000025</name>
Aug 16 09:27:59 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:27:59 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:27:59 user nova-compute[73208]:   <metadata>
Aug 16 09:27:59 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:27:59 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:27:59 user nova-compute[73208]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-297253768</nova:name>
Aug 16 09:27:59 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:27:57</nova:creationTime>
Aug 16 09:27:59 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:27:59 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:27:59 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:27:59 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:27:59 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:27:59 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:27:59 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:27:59 user nova-compute[73208]:       <nova:owner>
Aug 16 09:27:59 user nova-compute[73208]:         <nova:user uuid="91255b4dbf814537906275122738afcf">tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member</nova:user>
Aug 16 09:27:59 user nova-compute[73208]:         <nova:project uuid="a5da0d7fd51c4dcaba48f74dc423e684">tempest-ServerBootFromVolumeStableRescueTest-1980932529</nova:project>
Aug 16 09:27:59 user nova-compute[73208]:       </nova:owner>
Aug 16 09:27:59 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:27:59 user nova-compute[73208]:       <nova:ports>
Aug 16 09:27:59 user nova-compute[73208]:         <nova:port uuid="c2285ef4-64f2-42cf-8995-04bc6ce4258c">
Aug 16 09:27:59 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:27:59 user nova-compute[73208]:         </nova:port>
Aug 16 09:27:59 user nova-compute[73208]:       </nova:ports>
Aug 16 09:27:59 user nova-compute[73208]:     </nova:instance>
Aug 16 09:27:59 user nova-compute[73208]:   </metadata>
Aug 16 09:27:59 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:27:59 user nova-compute[73208]:     <system>
Aug 16 09:27:59 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:27:59 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:27:59 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:27:59 user nova-compute[73208]:       <entry name="serial">abbf98e1-d609-49ab-8b7f-6b8d57f2718a</entry>
Aug 16 09:27:59 user nova-compute[73208]:       <entry name="uuid">abbf98e1-d609-49ab-8b7f-6b8d57f2718a</entry>
Aug 16 09:27:59 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:27:59 user nova-compute[73208]:     </system>
Aug 16 09:27:59 user nova-compute[73208]:   </sysinfo>
Aug 16 09:27:59 user nova-compute[73208]:   <os>
Aug 16 09:27:59 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:27:59 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:27:59 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:27:59 user nova-compute[73208]:   </os>
Aug 16 09:27:59 user nova-compute[73208]:   <features>
Aug 16 09:27:59 user nova-compute[73208]:     <acpi/>
Aug 16 09:27:59 user nova-compute[73208]:     <apic/>
Aug 16 09:27:59 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:27:59 user nova-compute[73208]:   </features>
Aug 16 09:27:59 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:27:59 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:27:59 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:27:59 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:27:59 user nova-compute[73208]:   </clock>
Aug 16 09:27:59 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:27:59 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:27:59 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:27:59 user nova-compute[73208]:   </cpu>
Aug 16 09:27:59 user nova-compute[73208]:   <devices>
Aug 16 09:27:59 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:27:59 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:27:59 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:27:59 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:27:59 user nova-compute[73208]:       <serial>b36ffde6-8ea6-4113-b957-24b45608e9c4</serial>
Aug 16 09:27:59 user nova-compute[73208]:     </disk>
Aug 16 09:27:59 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:27:59 user nova-compute[73208]:       <mac address="fa:16:3e:98:48:f3"/>
Aug 16 09:27:59 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:27:59 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:27:59 user nova-compute[73208]:       <target dev="tapc2285ef4-64"/>
Aug 16 09:27:59 user nova-compute[73208]:     </interface>
Aug 16 09:27:59 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:27:59 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/console.log" append="off"/>
Aug 16 09:27:59 user nova-compute[73208]:     </serial>
Aug 16 09:27:59 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:27:59 user nova-compute[73208]:     <video>
Aug 16 09:27:59 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:27:59 user nova-compute[73208]:     </video>
Aug 16 09:27:59 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:27:59 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:27:59 user nova-compute[73208]:     </rng>
Aug 16 09:27:59 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:27:59 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:27:59 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:27:59 user nova-compute[73208]:     </memballoon>
Aug 16 09:27:59 user nova-compute[73208]:   </devices>
Aug 16 09:27:59 user nova-compute[73208]: </domain>
Aug 16 09:27:59 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-297253768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-297253768',id=37,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-04qko1jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:27:36Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=abbf98e1-d609-49ab-8b7f-6b8d57f2718a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=c2285ef4-64f2-42cf-8995-04bc6ce4258c,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2285ef4-64') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG os_vif [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=c2285ef4-64f2-42cf-8995-04bc6ce4258c,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2285ef4-64') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2285ef4-64, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2285ef4-64, col_values=(('external_ids', {'iface-id': 'c2285ef4-64f2-42cf-8995-04bc6ce4258c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:48:f3', 'vm-uuid': 'abbf98e1-d609-49ab-8b7f-6b8d57f2718a'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:27:59 user nova-compute[73208]: INFO os_vif [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=c2285ef4-64f2-42cf-8995-04bc6ce4258c,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2285ef4-64')
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No VIF found with MAC fa:16:3e:98:48:f3, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-d56bd000-bbc3-4739-ab4e-bf2f3ad08c7d req-0c515af3-ca85-445d-a3ff-25b8522a8f05 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-changed-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-d56bd000-bbc3-4739-ab4e-bf2f3ad08c7d req-0c515af3-ca85-445d-a3ff-25b8522a8f05 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Refreshing instance network info cache due to event network-changed-8b20c094-a0f7-4c34-a98d-d2938c3ebb28. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d56bd000-bbc3-4739-ab4e-bf2f3ad08c7d req-0c515af3-ca85-445d-a3ff-25b8522a8f05 service nova] Acquiring lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d56bd000-bbc3-4739-ab4e-bf2f3ad08c7d req-0c515af3-ca85-445d-a3ff-25b8522a8f05 service nova] Acquired lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:27:59 user nova-compute[73208]: DEBUG nova.network.neutron [req-d56bd000-bbc3-4739-ab4e-bf2f3ad08c7d req-0c515af3-ca85-445d-a3ff-25b8522a8f05 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Refreshing network info cache for port 8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:28:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-d56bd000-bbc3-4739-ab4e-bf2f3ad08c7d req-0c515af3-ca85-445d-a3ff-25b8522a8f05 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updated VIF entry in instance network info cache for port 8b20c094-a0f7-4c34-a98d-d2938c3ebb28. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:28:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-d56bd000-bbc3-4739-ab4e-bf2f3ad08c7d req-0c515af3-ca85-445d-a3ff-25b8522a8f05 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:28:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d56bd000-bbc3-4739-ab4e-bf2f3ad08c7d req-0c515af3-ca85-445d-a3ff-25b8522a8f05 service nova] Releasing lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:28:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:28:00 user nova-compute[73208]: INFO nova.compute.manager [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] instance snapshotting
Aug 16 09:28:01 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Beginning live snapshot process
Aug 16 09:28:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-d921453a-99f2-432e-9c81-448e3831a844 req-9af2ee57-dc6e-46b9-9c8c-1158fc8ed793 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d921453a-99f2-432e-9c81-448e3831a844 req-9af2ee57-dc6e-46b9-9c8c-1158fc8ed793 service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d921453a-99f2-432e-9c81-448e3831a844 req-9af2ee57-dc6e-46b9-9c8c-1158fc8ed793 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d921453a-99f2-432e-9c81-448e3831a844 req-9af2ee57-dc6e-46b9-9c8c-1158fc8ed793 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-d921453a-99f2-432e-9c81-448e3831a844 req-9af2ee57-dc6e-46b9-9c8c-1158fc8ed793 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:28:01 user nova-compute[73208]: WARNING nova.compute.manager [req-d921453a-99f2-432e-9c81-448e3831a844 req-9af2ee57-dc6e-46b9-9c8c-1158fc8ed793 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state building and task_state spawning.
Aug 16 09:28:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json -f qcow2 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json -f qcow2" returned: 0 in 0.240s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json -f qcow2 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json -f qcow2" returned: 0 in 0.276s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmnpgxqj3/898cdea85b684a5aaa0612edeccb3b73.delta 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:02 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmnpgxqj3/898cdea85b684a5aaa0612edeccb3b73.delta 1073741824" returned: 0 in 0.055s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 09:28:02 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178067.478241, da41698d-660d-47a7-91d9-af48a0f755bf => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:28:02 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] VM Stopped (Lifecycle Event)
Aug 16 09:28:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a79e18ed-f4ce-434e-b953-1341bfdb5879 None None] [instance: da41698d-660d-47a7-91d9-af48a0f755bf] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:28:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-3fbaa982-34d7-4e1c-b4cc-9aabda2e0ffb req-afa8fd16-5420-43a0-aff1-0c8ae87555dc service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3fbaa982-34d7-4e1c-b4cc-9aabda2e0ffb req-afa8fd16-5420-43a0-aff1-0c8ae87555dc service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3fbaa982-34d7-4e1c-b4cc-9aabda2e0ffb req-afa8fd16-5420-43a0-aff1-0c8ae87555dc service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3fbaa982-34d7-4e1c-b4cc-9aabda2e0ffb req-afa8fd16-5420-43a0-aff1-0c8ae87555dc service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-3fbaa982-34d7-4e1c-b4cc-9aabda2e0ffb req-afa8fd16-5420-43a0-aff1-0c8ae87555dc service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:28:03 user nova-compute[73208]: WARNING nova.compute.manager [req-3fbaa982-34d7-4e1c-b4cc-9aabda2e0ffb req-afa8fd16-5420-43a0-aff1-0c8ae87555dc service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state building and task_state spawning.
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178083.2716644, abbf98e1-d609-49ab-8b7f-6b8d57f2718a => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:28:03 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] VM Resumed (Lifecycle Event)
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:28:03 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance spawned successfully.
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73208) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 09:28:03 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:28:03 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178083.273216, abbf98e1-d609-49ab-8b7f-6b8d57f2718a => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:28:03 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] VM Started (Lifecycle Event)
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:03 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:28:03 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmnpgxqj3/898cdea85b684a5aaa0612edeccb3b73.delta /opt/stack/data/nova/instances/snapshots/tmpmnpgxqj3/898cdea85b684a5aaa0612edeccb3b73 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:03 user nova-compute[73208]: INFO nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 16 09:28:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:28:03 user nova-compute[73208]: INFO nova.compute.manager [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Took 28.21 seconds to build instance.
Aug 16 09:28:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1bcb5c70-33db-4c38-8d28-076f84fd2910 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.395s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmnpgxqj3/898cdea85b684a5aaa0612edeccb3b73.delta /opt/stack/data/nova/instances/snapshots/tmpmnpgxqj3/898cdea85b684a5aaa0612edeccb3b73" returned: 0 in 0.674s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:04 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Snapshot extracted, beginning image upload
Aug 16 09:28:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:06 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Snapshot image upload complete
Aug 16 09:28:06 user nova-compute[73208]: INFO nova.compute.manager [None req-18bcff13-570e-4dd3-9975-3d3264086ba2 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Took 5.72 seconds to snapshot the instance on the hypervisor.
Aug 16 09:28:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:28:16 user nova-compute[73208]: INFO nova.compute.claims [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Claim successful on node user
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:28:16 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:28:16 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:28:17 user nova-compute[73208]: INFO nova.virt.block_device [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Booting with volume ac69d2fd-e25a-4976-b618-65c6280a3589 at /dev/vda
Aug 16 09:28:17 user nova-compute[73208]: DEBUG nova.policy [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9014d0cab7e416fa4e030653fd4b01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21041c92f02043e0baa0f6abeadcd78e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG os_brick.utils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d5dfb7-53b1-4367-b819-65ebfda15ce9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1356d4d-4c7b-4f9a-8d6d-2343de3e425a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513d522-4ee9-4939-9099-0a92364728bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee9ea74-5989-4048-856a-c8c96dfeef2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:28:17 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:28:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c451693-68c1-48aa-9b3a-48f5c93b105d]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG os_brick.utils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating existing volume attachment record: 5fe1dbaf-374f-4595-817b-902be5655c8a {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:28:17 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Successfully created port: 33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:28:18 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Successfully updated port: 33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:28:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:28:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:28:18 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:28:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-80a24869-97bc-43b1-9a4e-3c4bf460c11d req-dea202d4-2bd3-4ea2-a25a-49adafec510b service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:28:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-80a24869-97bc-43b1-9a4e-3c4bf460c11d req-dea202d4-2bd3-4ea2-a25a-49adafec510b service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing instance network info cache due to event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:28:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80a24869-97bc-43b1-9a4e-3c4bf460c11d req-dea202d4-2bd3-4ea2-a25a-49adafec510b service nova] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:28:18 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance network_info: |[{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80a24869-97bc-43b1-9a4e-3c4bf460c11d req-dea202d4-2bd3-4ea2-a25a-49adafec510b service nova] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG nova.network.neutron [req-80a24869-97bc-43b1-9a4e-3c4bf460c11d req-dea202d4-2bd3-4ea2-a25a-49adafec510b service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG nova.network.neutron [req-80a24869-97bc-43b1-9a4e-3c4bf460c11d req-dea202d4-2bd3-4ea2-a25a-49adafec510b service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updated VIF entry in instance network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG nova.network.neutron [req-80a24869-97bc-43b1-9a4e-3c4bf460c11d req-dea202d4-2bd3-4ea2-a25a-49adafec510b service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:28:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80a24869-97bc-43b1-9a4e-3c4bf460c11d req-dea202d4-2bd3-4ea2-a25a-49adafec510b service nova] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:28:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:28:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Creating image(s)
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Ensure instance console log exists: /opt/stack/data/nova/instances/aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Start _get_guest_xml network_info=[{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '5fe1dbaf-374f-4595-817b-902be5655c8a', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWDtyxEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac69d2fd-e25a-4976-b618-65c6280a3589', 'serial': 'ac69d2fd-e25a-4976-b618-65c6280a3589'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:28:27 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:28:27 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWDtyxEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:28:27 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:28:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:28:27 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:28:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:28:27 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a05865-6f69-44ea-82ef-3e21d79edf73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:28:27 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e4e0a6-06fa-40d6-af14-c8d52c2abb6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589] added
Aug 16 09:28:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eea0dd-a8eb-4b7b-879e-95479beaa8c3]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef74d0f-0dcf-4ce3-a422-e956c23b8642]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWDtyxEa {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWDtyxEa" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[11872fd8-21d4-4c97-a8e7-007f0503a9ee]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWDtyxEa'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b19b5b4-9d82-4f4f-b255-b6fa64d9a1c8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9402eb9-c62f-47b7-b260-f780c2fcd40d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178acfc-8855-4339-8877-5de10d26ca24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260]
Aug 16 09:28:28 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260] successful.
Aug 16 09:28:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2951de-8030-40b6-b8cc-520c0ba1bad7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e5f87d-723c-4437-813c-2b6804dd53fd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:28:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1f1b7f-ec47-411a-8093-79beb791a8de]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWDtyxEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:28:28 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23637373935383230', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373935383230', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-520207354',display_name='tempest-TestShelveInstance-server-520207354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-520207354',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTxujKSCteZ5P6lR4UwzRys67W8lMq/TyHdhvHBTlgZ+s9EYE4Ik7pvRHc0oNFhtBuedzNM172/eZhL3HuwHksgGZahHrqHdc9j4QckywqYhlcoHYVKroFDwgKNX74Kgg==',key_name='tempest-TestShelveInstance-1927113377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21041c92f02043e0baa0f6abeadcd78e',ramdisk_id='',reservation_id='r-g3kxydmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1402301442',owner_user_name='tempest-TestShelveInstance-1402301442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:28:17Z,user_data=None,user_id='f9014d0cab7e416fa4e030653fd4b01d',uuid=aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converting VIF {"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lazy-loading 'pci_devices' on Instance uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:28:29 user nova-compute[73208]:   <uuid>aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727</uuid>
Aug 16 09:28:29 user nova-compute[73208]:   <name>instance-00000027</name>
Aug 16 09:28:29 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:28:29 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:28:29 user nova-compute[73208]:   <metadata>
Aug 16 09:28:29 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:28:29 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:28:29 user nova-compute[73208]:       <nova:name>tempest-TestShelveInstance-server-520207354</nova:name>
Aug 16 09:28:29 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:28:27</nova:creationTime>
Aug 16 09:28:29 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:28:29 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:28:29 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:28:29 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:28:29 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:28:29 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:28:29 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:28:29 user nova-compute[73208]:       <nova:owner>
Aug 16 09:28:29 user nova-compute[73208]:         <nova:user uuid="f9014d0cab7e416fa4e030653fd4b01d">tempest-TestShelveInstance-1402301442-project-member</nova:user>
Aug 16 09:28:29 user nova-compute[73208]:         <nova:project uuid="21041c92f02043e0baa0f6abeadcd78e">tempest-TestShelveInstance-1402301442</nova:project>
Aug 16 09:28:29 user nova-compute[73208]:       </nova:owner>
Aug 16 09:28:29 user nova-compute[73208]:       <nova:ports>
Aug 16 09:28:29 user nova-compute[73208]:         <nova:port uuid="33df2ec9-e747-45f1-b34a-03b6dd017cd7">
Aug 16 09:28:29 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:28:29 user nova-compute[73208]:         </nova:port>
Aug 16 09:28:29 user nova-compute[73208]:       </nova:ports>
Aug 16 09:28:29 user nova-compute[73208]:     </nova:instance>
Aug 16 09:28:29 user nova-compute[73208]:   </metadata>
Aug 16 09:28:29 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:28:29 user nova-compute[73208]:     <system>
Aug 16 09:28:29 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:28:29 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:28:29 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:28:29 user nova-compute[73208]:       <entry name="serial">aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727</entry>
Aug 16 09:28:29 user nova-compute[73208]:       <entry name="uuid">aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727</entry>
Aug 16 09:28:29 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:28:29 user nova-compute[73208]:     </system>
Aug 16 09:28:29 user nova-compute[73208]:   </sysinfo>
Aug 16 09:28:29 user nova-compute[73208]:   <os>
Aug 16 09:28:29 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:28:29 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:28:29 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:28:29 user nova-compute[73208]:   </os>
Aug 16 09:28:29 user nova-compute[73208]:   <features>
Aug 16 09:28:29 user nova-compute[73208]:     <acpi/>
Aug 16 09:28:29 user nova-compute[73208]:     <apic/>
Aug 16 09:28:29 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:28:29 user nova-compute[73208]:   </features>
Aug 16 09:28:29 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:28:29 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:28:29 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:28:29 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:28:29 user nova-compute[73208]:   </clock>
Aug 16 09:28:29 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:28:29 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:28:29 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:28:29 user nova-compute[73208]:   </cpu>
Aug 16 09:28:29 user nova-compute[73208]:   <devices>
Aug 16 09:28:29 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:28:29 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:28:29 user nova-compute[73208]:       <source dev="/dev/sdd"/>
Aug 16 09:28:29 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:28:29 user nova-compute[73208]:       <serial>ac69d2fd-e25a-4976-b618-65c6280a3589</serial>
Aug 16 09:28:29 user nova-compute[73208]:     </disk>
Aug 16 09:28:29 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:28:29 user nova-compute[73208]:       <mac address="fa:16:3e:54:bb:79"/>
Aug 16 09:28:29 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:28:29 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:28:29 user nova-compute[73208]:       <target dev="tap33df2ec9-e7"/>
Aug 16 09:28:29 user nova-compute[73208]:     </interface>
Aug 16 09:28:29 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:28:29 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727/console.log" append="off"/>
Aug 16 09:28:29 user nova-compute[73208]:     </serial>
Aug 16 09:28:29 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:28:29 user nova-compute[73208]:     <video>
Aug 16 09:28:29 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:28:29 user nova-compute[73208]:     </video>
Aug 16 09:28:29 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:28:29 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:28:29 user nova-compute[73208]:     </rng>
Aug 16 09:28:29 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:28:29 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:28:29 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:28:29 user nova-compute[73208]:     </memballoon>
Aug 16 09:28:29 user nova-compute[73208]:   </devices>
Aug 16 09:28:29 user nova-compute[73208]: </domain>
Aug 16 09:28:29 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-520207354',display_name='tempest-TestShelveInstance-server-520207354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-520207354',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTxujKSCteZ5P6lR4UwzRys67W8lMq/TyHdhvHBTlgZ+s9EYE4Ik7pvRHc0oNFhtBuedzNM172/eZhL3HuwHksgGZahHrqHdc9j4QckywqYhlcoHYVKroFDwgKNX74Kgg==',key_name='tempest-TestShelveInstance-1927113377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21041c92f02043e0baa0f6abeadcd78e',ramdisk_id='',reservation_id='r-g3kxydmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1402301442',owner_user_name='tempest-TestShelveInstance-1402301442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:28:17Z,user_data=None,user_id='f9014d0cab7e416fa4e030653fd4b01d',uuid=aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converting VIF {"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG os_vif [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33df2ec9-e7, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33df2ec9-e7, col_values=(('external_ids', {'iface-id': '33df2ec9-e747-45f1-b34a-03b6dd017cd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:bb:79', 'vm-uuid': 'aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:29 user nova-compute[73208]: INFO os_vif [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7')
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] No VIF found with MAC fa:16:3e:54:bb:79, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:28:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:31 user nova-compute[73208]: DEBUG nova.compute.manager [req-27377dde-5653-4cf4-a75b-d426a1af2a7e req-8ec04fbf-bf51-4c66-be53-bdb3ff55fe68 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:28:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-27377dde-5653-4cf4-a75b-d426a1af2a7e req-8ec04fbf-bf51-4c66-be53-bdb3ff55fe68 service nova] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-27377dde-5653-4cf4-a75b-d426a1af2a7e req-8ec04fbf-bf51-4c66-be53-bdb3ff55fe68 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-27377dde-5653-4cf4-a75b-d426a1af2a7e req-8ec04fbf-bf51-4c66-be53-bdb3ff55fe68 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:31 user nova-compute[73208]: DEBUG nova.compute.manager [req-27377dde-5653-4cf4-a75b-d426a1af2a7e req-8ec04fbf-bf51-4c66-be53-bdb3ff55fe68 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] No waiting events found dispatching network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:28:31 user nova-compute[73208]: WARNING nova.compute.manager [req-27377dde-5653-4cf4-a75b-d426a1af2a7e req-8ec04fbf-bf51-4c66-be53-bdb3ff55fe68 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received unexpected event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 for instance with vm_state building and task_state spawning.
Aug 16 09:28:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178112.8585265, aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:28:32 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] VM Resumed (Lifecycle Event)
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:28:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance spawned successfully.
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:28:32 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178112.8606293, aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:28:32 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] VM Started (Lifecycle Event)
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:28:32 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:28:32 user nova-compute[73208]: INFO nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:28:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:33 user nova-compute[73208]: INFO nova.compute.manager [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Took 16.78 seconds to build instance.
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a30575ff-f015-43df-a114-49a6d86a08b8 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.904s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-885307d6-35b9-4095-a86f-4421b63394c9 req-1ee344d6-edd8-4ae9-a96b-286f3f10cfe9 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-885307d6-35b9-4095-a86f-4421b63394c9 req-1ee344d6-edd8-4ae9-a96b-286f3f10cfe9 service nova] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-885307d6-35b9-4095-a86f-4421b63394c9 req-1ee344d6-edd8-4ae9-a96b-286f3f10cfe9 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-885307d6-35b9-4095-a86f-4421b63394c9 req-1ee344d6-edd8-4ae9-a96b-286f3f10cfe9 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-885307d6-35b9-4095-a86f-4421b63394c9 req-1ee344d6-edd8-4ae9-a96b-286f3f10cfe9 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] No waiting events found dispatching network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:28:33 user nova-compute[73208]: WARNING nova.compute.manager [req-885307d6-35b9-4095-a86f-4421b63394c9 req-1ee344d6-edd8-4ae9-a96b-286f3f10cfe9 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received unexpected event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 for instance with vm_state active and task_state None.
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:28:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:28:35 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:28:35 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7790MB free_disk=25.236927032470703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance af45d645-fd93-4e44-9700-018b121659c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 3b0705d8-5d30-4eb8-9fb3-80383add75b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance abbf98e1-d609-49ab-8b7f-6b8d57f2718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f62bba74-2ef0-46f4-adee-7695e2379018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:28:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:28:36 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:28:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:28:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid e23ec51a-a5cb-451b-91aa-f2b241d2b0cd {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updating instance_info_cache with network_info: [{"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:28:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:28:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:28:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:28:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:28:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:28:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:28:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:28:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:22 user nova-compute[73208]: INFO nova.compute.manager [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Terminating instance
Aug 16 09:29:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-1e57b58e-3e84-4dd1-9b84-4906a18f0791 req-1c9baa88-e79b-4e11-8fbd-c41a76145e38 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received event network-vif-unplugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e57b58e-3e84-4dd1-9b84-4906a18f0791 req-1c9baa88-e79b-4e11-8fbd-c41a76145e38 service nova] Acquiring lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e57b58e-3e84-4dd1-9b84-4906a18f0791 req-1c9baa88-e79b-4e11-8fbd-c41a76145e38 service nova] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e57b58e-3e84-4dd1-9b84-4906a18f0791 req-1c9baa88-e79b-4e11-8fbd-c41a76145e38 service nova] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-1e57b58e-3e84-4dd1-9b84-4906a18f0791 req-1c9baa88-e79b-4e11-8fbd-c41a76145e38 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] No waiting events found dispatching network-vif-unplugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG nova.compute.manager [req-1e57b58e-3e84-4dd1-9b84-4906a18f0791 req-1c9baa88-e79b-4e11-8fbd-c41a76145e38 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received event network-vif-unplugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:29:22 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Instance destroyed successfully.
Aug 16 09:29:22 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lazy-loading 'resources' on Instance uuid 3b0705d8-5d30-4eb8-9fb3-80383add75b9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-959534735',display_name='tempest-VolumesActionsTest-instance-959534735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-959534735',id=36,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:27:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f192344e7d44f28f954625aea2d9d4',ramdisk_id='',reservation_id='r-bnii8my1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1328217380',owner_user_name='tempest-VolumesActionsTest-1328217380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:27:25Z,user_data=None,user_id='7cc24a14b3af4b1da397e15e2eb24b6a',uuid=3b0705d8-5d30-4eb8-9fb3-80383add75b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Converting VIF {"id": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "address": "fa:16:3e:c9:31:42", "network": {"id": "17a98ca3-287d-48cf-b872-689576e6e9af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1602337887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f192344e7d44f28f954625aea2d9d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a8ea9f-f5", "ovs_interfaceid": "c8a8ea9f-f5ea-427d-9ffd-6385494871b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:31:42,bridge_name='br-int',has_traffic_filtering=True,id=c8a8ea9f-f5ea-427d-9ffd-6385494871b2,network=Network(17a98ca3-287d-48cf-b872-689576e6e9af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a8ea9f-f5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG os_vif [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:31:42,bridge_name='br-int',has_traffic_filtering=True,id=c8a8ea9f-f5ea-427d-9ffd-6385494871b2,network=Network(17a98ca3-287d-48cf-b872-689576e6e9af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a8ea9f-f5') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8a8ea9f-f5, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:22 user nova-compute[73208]: INFO os_vif [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:31:42,bridge_name='br-int',has_traffic_filtering=True,id=c8a8ea9f-f5ea-427d-9ffd-6385494871b2,network=Network(17a98ca3-287d-48cf-b872-689576e6e9af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a8ea9f-f5')
Aug 16 09:29:22 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Deleting instance files /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9_del
Aug 16 09:29:22 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Deletion of /opt/stack/data/nova/instances/3b0705d8-5d30-4eb8-9fb3-80383add75b9_del complete
Aug 16 09:29:23 user nova-compute[73208]: INFO nova.compute.manager [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 09:29:23 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-ea66d6be-ddbd-4c77-8af3-f038ce44af1c req-ae89641b-4e5a-4560-9489-e91f7e1ae866 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received event network-vif-deleted-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:29:23 user nova-compute[73208]: INFO nova.compute.manager [req-ea66d6be-ddbd-4c77-8af3-f038ce44af1c req-ae89641b-4e5a-4560-9489-e91f7e1ae866 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Neutron deleted interface c8a8ea9f-f5ea-427d-9ffd-6385494871b2; detaching it from the instance and deleting it from the info cache
Aug 16 09:29:23 user nova-compute[73208]: DEBUG nova.network.neutron [req-ea66d6be-ddbd-4c77-8af3-f038ce44af1c req-ae89641b-4e5a-4560-9489-e91f7e1ae866 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:29:23 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Took 0.53 seconds to deallocate network for instance.
Aug 16 09:29:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-ea66d6be-ddbd-4c77-8af3-f038ce44af1c req-ae89641b-4e5a-4560-9489-e91f7e1ae866 service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Detach interface failed, port_id=c8a8ea9f-f5ea-427d-9ffd-6385494871b2, reason: Instance 3b0705d8-5d30-4eb8-9fb3-80383add75b9 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:29:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:23 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Deleted allocations for instance 3b0705d8-5d30-4eb8-9fb3-80383add75b9
Aug 16 09:29:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f51de48d-326c-4585-a28e-6acf250d689a tempest-VolumesActionsTest-1328217380 tempest-VolumesActionsTest-1328217380-project-member] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.919s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:24 user nova-compute[73208]: DEBUG nova.compute.manager [req-970d130c-e18f-4d25-984e-ee5f529bced9 req-14e8e82c-e766-4bb6-962b-1304368e0a0f service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received event network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:29:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-970d130c-e18f-4d25-984e-ee5f529bced9 req-14e8e82c-e766-4bb6-962b-1304368e0a0f service nova] Acquiring lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-970d130c-e18f-4d25-984e-ee5f529bced9 req-14e8e82c-e766-4bb6-962b-1304368e0a0f service nova] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-970d130c-e18f-4d25-984e-ee5f529bced9 req-14e8e82c-e766-4bb6-962b-1304368e0a0f service nova] Lock "3b0705d8-5d30-4eb8-9fb3-80383add75b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:24 user nova-compute[73208]: DEBUG nova.compute.manager [req-970d130c-e18f-4d25-984e-ee5f529bced9 req-14e8e82c-e766-4bb6-962b-1304368e0a0f service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] No waiting events found dispatching network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:29:24 user nova-compute[73208]: WARNING nova.compute.manager [req-970d130c-e18f-4d25-984e-ee5f529bced9 req-14e8e82c-e766-4bb6-962b-1304368e0a0f service nova] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Received unexpected event network-vif-plugged-c8a8ea9f-f5ea-427d-9ffd-6385494871b2 for instance with vm_state deleted and task_state None.
Aug 16 09:29:26 user nova-compute[73208]: INFO nova.compute.manager [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Rescuing
Aug 16 09:29:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquired lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updating instance_info_cache with network_info: [{"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Releasing lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-cdfd41f9-02f4-4936-96ad-314991817b0a req-ea0c4ee1-1a1b-4344-8b62-8310d41157c9 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cdfd41f9-02f4-4936-96ad-314991817b0a req-ea0c4ee1-1a1b-4344-8b62-8310d41157c9 service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cdfd41f9-02f4-4936-96ad-314991817b0a req-ea0c4ee1-1a1b-4344-8b62-8310d41157c9 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cdfd41f9-02f4-4936-96ad-314991817b0a req-ea0c4ee1-1a1b-4344-8b62-8310d41157c9 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-cdfd41f9-02f4-4936-96ad-314991817b0a req-ea0c4ee1-1a1b-4344-8b62-8310d41157c9 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:29:26 user nova-compute[73208]: WARNING nova.compute.manager [req-cdfd41f9-02f4-4936-96ad-314991817b0a req-ea0c4ee1-1a1b-4344-8b62-8310d41157c9 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state active and task_state rescuing.
Aug 16 09:29:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance destroyed successfully.
Aug 16 09:29:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Attempting a stable device rescue
Aug 16 09:29:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73208) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 09:29:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance directory exists: not creating {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 09:29:27 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Creating image(s)
Aug 16 09:29:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "/opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "/opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "/opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:27 user nova-compute[73208]: DEBUG nova.objects.instance [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'trusted_certs' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "a820999ab0220465671fd40ff98e8f6365a2ac86" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "a820999ab0220465671fd40ff98e8f6365a2ac86" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86.part --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG nova.virt.images [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] 439708dc-580a-41b4-942b-6b77dec265a3 was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86.part /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-c4e1754e-39d7-46c2-bcba-5ad179857125 req-ecc84b4d-84c3-4100-80d4-6c7153273947 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c4e1754e-39d7-46c2-bcba-5ad179857125 req-ecc84b4d-84c3-4100-80d4-6c7153273947 service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c4e1754e-39d7-46c2-bcba-5ad179857125 req-ecc84b4d-84c3-4100-80d4-6c7153273947 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c4e1754e-39d7-46c2-bcba-5ad179857125 req-ecc84b4d-84c3-4100-80d4-6c7153273947 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-c4e1754e-39d7-46c2-bcba-5ad179857125 req-ecc84b4d-84c3-4100-80d4-6c7153273947 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:29:28 user nova-compute[73208]: WARNING nova.compute.manager [req-c4e1754e-39d7-46c2-bcba-5ad179857125 req-ecc84b4d-84c3-4100-80d4-6c7153273947 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state active and task_state rescuing.
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86.part /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86.converted" returned: 0 in 0.786s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "a820999ab0220465671fd40ff98e8f6365a2ac86" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.244s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "a820999ab0220465671fd40ff98e8f6365a2ac86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "a820999ab0220465671fd40ff98e8f6365a2ac86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86 --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86,backing_fmt=raw /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86,backing_fmt=raw /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue" returned: 0 in 0.056s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "a820999ab0220465671fd40ff98e8f6365a2ac86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG nova.objects.instance [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'migration_context' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Start _get_guest_xml network_info=[{"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "vif_mac": "fa:16:3e:98:48:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '439708dc-580a-41b4-942b-6b77dec265a3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'ab2eed66-5a40-4fff-8f0f-c6a1e3771a22', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLUZldBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'abbf98e1-d609-49ab-8b7f-6b8d57f2718a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b36ffde6-8ea6-4113-b957-24b45608e9c4', 'serial': 'b36ffde6-8ea6-4113-b957-24b45608e9c4'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:29:29 user nova-compute[73208]: DEBUG nova.objects.instance [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'resources' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.objects.instance [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'numa_topology' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:30 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:29:30 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.objects.instance [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'vcpu_model' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLUZldBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:29:30 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:29:30 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:29:30 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2f2b06-c1fc-4214-aa19-2776153a5984]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jLUZldBw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 09:29:30 user nova-compute[73208]: node.name = iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4
Aug 16 09:29:30 user nova-compute[73208]: node.tpgt = -1
Aug 16 09:29:30 user nova-compute[73208]: node.startup = automatic
Aug 16 09:29:30 user nova-compute[73208]: node.leading_login = No
Aug 16 09:29:30 user nova-compute[73208]: iface.iscsi_ifacename = default
Aug 16 09:29:30 user nova-compute[73208]: iface.net_ifacename = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.ipaddress = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.prefix_len = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.hwaddress = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.transport_name = tcp
Aug 16 09:29:30 user nova-compute[73208]: iface.initiatorname = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.state = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.vlan_id = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.vlan_priority = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.vlan_state = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.iface_num = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.mtu = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.port = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.bootproto = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.subnet_mask = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.gateway = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.dhcp_alt_client_id = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.dhcp_dns = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.dhcp_learn_iqn = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.dhcp_vendor_id_state = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.dhcp_vendor_id = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.dhcp_slp_da = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.fragmentation = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.gratuitous_arp = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.incoming_forwarding = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.tos_state = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.tos = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.ttl = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.delayed_ack = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.tcp_nagle = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.tcp_wsf_state = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.tcp_wsf = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.tcp_timer_scale = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.tcp_timestamp = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.redirect = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.def_task_mgmt_timeout = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.header_digest = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.data_digest = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.immediate_data = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.initial_r2t = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.data_seq_inorder = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.data_pdu_inorder = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.erl = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.max_receive_data_len = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.first_burst_len = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.max_outstanding_r2t = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.max_burst_len = 0
Aug 16 09:29:30 user nova-compute[73208]: iface.chap_auth = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.bidi_chap = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.strict_login_compliance = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.discovery_auth = <empty>
Aug 16 09:29:30 user nova-compute[73208]: iface.discovery_logout = <empty>
Aug 16 09:29:30 user nova-compute[73208]: node.discovery_address = <empty>
Aug 16 09:29:30 user nova-compute[73208]: node.discovery_port = 0
Aug 16 09:29:30 user nova-compute[73208]: node.discovery_type = static
Aug 16 09:29:30 user nova-compute[73208]: node.session.initial_cmdsn = 0
Aug 16 09:29:30 user nova-compute[73208]: node.session.initial_login_retry_max = 8
Aug 16 09:29:30 user nova-compute[73208]: node.session.xmit_thread_priority = -20
Aug 16 09:29:30 user nova-compute[73208]: node.session.cmds_max = 128
Aug 16 09:29:30 user nova-compute[73208]: node.session.queue_depth = 32
Aug 16 09:29:30 user nova-compute[73208]: node.session.nr_sessions = 1
Aug 16 09:29:30 user nova-compute[73208]: node.session.auth.authmethod = CHAP
Aug 16 09:29:30 user nova-compute[73208]: node.session.auth.username = jLUZldBw
Aug 16 09:29:30 user nova-compute[73208]: node.session.auth.password = ***
Aug 16 09:29:30 user nova-compute[73208]: node.session.auth.username_in = <empty>
Aug 16 09:29:30 user nova-compute[73208]: node.session.auth.password_in = <empty>
Aug 16 09:29:30 user nova-compute[73208]: node.session.auth.chap_algs = MD5
Aug 16 09:29:30 user nova-compute[73208]: node.session.timeo.replacement_timeout = 120
Aug 16 09:29:30 user nova-compute[73208]: node.session.err_timeo.abort_timeout = 15
Aug 16 09:29:30 user nova-compute[73208]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 09:29:30 user nova-compute[73208]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 09:29:30 user nova-compute[73208]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.FastAbort = Yes
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.InitialR2T = No
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.ImmediateData = Yes
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.MaxConnections = 1
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 09:29:30 user nova-compute[73208]: node.session.iscsi.ERL = 0
Aug 16 09:29:30 user nova-compute[73208]: node.session.scan = manual
Aug 16 09:29:30 user nova-compute[73208]: node.session.reopen_max = 0
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].address = 172.16.0.220
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].port = 3260
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].startup = manual
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].tcp.window_size = 524288
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].tcp.type_of_service = 0
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].timeo.logout_timeout = 15
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].timeo.login_timeout = 15
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].timeo.auth_timeout = 45
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].iscsi.DataDigest = None
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].iscsi.IFMarker = No
Aug 16 09:29:30 user nova-compute[73208]: node.conn[0].iscsi.OFMarker = No
Aug 16 09:29:30 user nova-compute[73208]: # END RECORD
Aug 16 09:29:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[297c7888-77f1-4b5f-a0b1-f267cb02e40b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bf4af2-c03a-44a0-bf5e-1b087181ac8d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLUZldBw {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLUZldBw" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff87a1c9-d0fa-4757-a500-2a5730c16d4c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLUZldBw'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c2d3ed-24df-4b03-a499-ddb07127988d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[83030109-b0d5-47ec-b261-bf6f94f01929]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:29:30 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:29:30 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:29:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:29:30 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:29:30 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:29:30 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] HCTL ('33', '0', '0', 0) found on session 41 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf646aa-93b8-4e9f-b33f-cbfdff739738]: (4, ('0 0 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Searching for a device in session 41 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLUZldBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] <== connect_volume: return (202ms) {'type': 'block', 'scsi_wwn': '23538613765636635', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538613765636635', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-297253768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-297253768',id=37,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:28:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-04qko1jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:28:04Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=abbf98e1-d609-49ab-8b7f-6b8d57f2718a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "vif_mac": "fa:16:3e:98:48:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "vif_mac": "fa:16:3e:98:48:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=c2285ef4-64f2-42cf-8995-04bc6ce4258c,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2285ef4-64') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.objects.instance [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'pci_devices' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:29:30 user nova-compute[73208]:   <uuid>abbf98e1-d609-49ab-8b7f-6b8d57f2718a</uuid>
Aug 16 09:29:30 user nova-compute[73208]:   <name>instance-00000025</name>
Aug 16 09:29:30 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:29:30 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:29:30 user nova-compute[73208]:   <metadata>
Aug 16 09:29:30 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:29:30 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:29:30 user nova-compute[73208]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-297253768</nova:name>
Aug 16 09:29:30 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:29:30</nova:creationTime>
Aug 16 09:29:30 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:29:30 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:29:30 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:29:30 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:29:30 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:29:30 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:29:30 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:29:30 user nova-compute[73208]:       <nova:owner>
Aug 16 09:29:30 user nova-compute[73208]:         <nova:user uuid="91255b4dbf814537906275122738afcf">tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member</nova:user>
Aug 16 09:29:30 user nova-compute[73208]:         <nova:project uuid="a5da0d7fd51c4dcaba48f74dc423e684">tempest-ServerBootFromVolumeStableRescueTest-1980932529</nova:project>
Aug 16 09:29:30 user nova-compute[73208]:       </nova:owner>
Aug 16 09:29:30 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:29:30 user nova-compute[73208]:       <nova:ports>
Aug 16 09:29:30 user nova-compute[73208]:         <nova:port uuid="c2285ef4-64f2-42cf-8995-04bc6ce4258c">
Aug 16 09:29:30 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:29:30 user nova-compute[73208]:         </nova:port>
Aug 16 09:29:30 user nova-compute[73208]:       </nova:ports>
Aug 16 09:29:30 user nova-compute[73208]:     </nova:instance>
Aug 16 09:29:30 user nova-compute[73208]:   </metadata>
Aug 16 09:29:30 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:29:30 user nova-compute[73208]:     <system>
Aug 16 09:29:30 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:29:30 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:29:30 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:29:30 user nova-compute[73208]:       <entry name="serial">abbf98e1-d609-49ab-8b7f-6b8d57f2718a</entry>
Aug 16 09:29:30 user nova-compute[73208]:       <entry name="uuid">abbf98e1-d609-49ab-8b7f-6b8d57f2718a</entry>
Aug 16 09:29:30 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:29:30 user nova-compute[73208]:     </system>
Aug 16 09:29:30 user nova-compute[73208]:   </sysinfo>
Aug 16 09:29:30 user nova-compute[73208]:   <os>
Aug 16 09:29:30 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:29:30 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:29:30 user nova-compute[73208]:   </os>
Aug 16 09:29:30 user nova-compute[73208]:   <features>
Aug 16 09:29:30 user nova-compute[73208]:     <acpi/>
Aug 16 09:29:30 user nova-compute[73208]:     <apic/>
Aug 16 09:29:30 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:29:30 user nova-compute[73208]:   </features>
Aug 16 09:29:30 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:29:30 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:29:30 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:29:30 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:29:30 user nova-compute[73208]:   </clock>
Aug 16 09:29:30 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:29:30 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:29:30 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:29:30 user nova-compute[73208]:   </cpu>
Aug 16 09:29:30 user nova-compute[73208]:   <devices>
Aug 16 09:29:30 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:29:30 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:29:30 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:29:30 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:29:30 user nova-compute[73208]:       <serial>b36ffde6-8ea6-4113-b957-24b45608e9c4</serial>
Aug 16 09:29:30 user nova-compute[73208]:     </disk>
Aug 16 09:29:30 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:29:30 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:29:30 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue"/>
Aug 16 09:29:30 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:29:30 user nova-compute[73208]:       <boot order="1"/>
Aug 16 09:29:30 user nova-compute[73208]:     </disk>
Aug 16 09:29:30 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:29:30 user nova-compute[73208]:       <mac address="fa:16:3e:98:48:f3"/>
Aug 16 09:29:30 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:29:30 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:29:30 user nova-compute[73208]:       <target dev="tapc2285ef4-64"/>
Aug 16 09:29:30 user nova-compute[73208]:     </interface>
Aug 16 09:29:30 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:29:30 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/console.log" append="off"/>
Aug 16 09:29:30 user nova-compute[73208]:     </serial>
Aug 16 09:29:30 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:29:30 user nova-compute[73208]:     <video>
Aug 16 09:29:30 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:29:30 user nova-compute[73208]:     </video>
Aug 16 09:29:30 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:29:30 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:29:30 user nova-compute[73208]:     </rng>
Aug 16 09:29:30 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:29:30 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:29:30 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:29:30 user nova-compute[73208]:     </memballoon>
Aug 16 09:29:30 user nova-compute[73208]:   </devices>
Aug 16 09:29:30 user nova-compute[73208]: </domain>
Aug 16 09:29:30 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:29:30 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance destroyed successfully.
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] No VIF found with MAC fa:16:3e:98:48:f3, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-b2e07fe2-f362-47f0-a636-8145c10bf285 req-104a89f6-e4bb-4ef7-905c-29cbe537b599 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2e07fe2-f362-47f0-a636-8145c10bf285 req-104a89f6-e4bb-4ef7-905c-29cbe537b599 service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2e07fe2-f362-47f0-a636-8145c10bf285 req-104a89f6-e4bb-4ef7-905c-29cbe537b599 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b2e07fe2-f362-47f0-a636-8145c10bf285 req-104a89f6-e4bb-4ef7-905c-29cbe537b599 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-b2e07fe2-f362-47f0-a636-8145c10bf285 req-104a89f6-e4bb-4ef7-905c-29cbe537b599 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:29:32 user nova-compute[73208]: WARNING nova.compute.manager [req-b2e07fe2-f362-47f0-a636-8145c10bf285 req-104a89f6-e4bb-4ef7-905c-29cbe537b599 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state active and task_state rescuing.
Aug 16 09:29:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:29:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8001MB free_disk=25.158924102783203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance af45d645-fd93-4e44-9700-018b121659c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance abbf98e1-d609-49ab-8b7f-6b8d57f2718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f62bba74-2ef0-46f4-adee-7695e2379018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:29:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:29:34 user nova-compute[73208]: WARNING nova.compute.manager [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state active and task_state rescuing.
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Received event network-changed-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Refreshing instance network info cache due to event network-changed-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] Acquiring lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] Acquired lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.network.neutron [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Refreshing network info cache for port 8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for abbf98e1-d609-49ab-8b7f-6b8d57f2718a due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178174.3287973, abbf98e1-d609-49ab-8b7f-6b8d57f2718a => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:29:34 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] VM Resumed (Lifecycle Event)
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-25e7aa3c-5885-48b8-95c4-d6df854b7a17 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:29:34 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178174.330226, abbf98e1-d609-49ab-8b7f-6b8d57f2718a => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:29:34 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] VM Started (Lifecycle Event)
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:29:34 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.network.neutron [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Updated VIF entry in instance network info cache for port 8300e258-72cb-4f0a-bc99-99f0f3a0dfc3. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG nova.network.neutron [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Updating instance_info_cache with network_info: [{"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:29:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6249cc5b-7585-4b5b-af1d-2edf515fd2e4 req-7686c5ca-1839-4dd3-943b-26787bc09b64 service nova] Releasing lock "refresh_cache-f62bba74-2ef0-46f4-adee-7695e2379018" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:29:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:37 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178162.94225, 3b0705d8-5d30-4eb8-9fb3-80383add75b9 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:29:37 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] VM Stopped (Lifecycle Event)
Aug 16 09:29:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-acd15544-c5da-4f16-bb28-374316e4aeb5 None None] [instance: 3b0705d8-5d30-4eb8-9fb3-80383add75b9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "f62bba74-2ef0-46f4-adee-7695e2379018" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG nova.objects.instance [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid f62bba74-2ef0-46f4-adee-7695e2379018 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "f62bba74-2ef0-46f4-adee-7695e2379018" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:38 user nova-compute[73208]: INFO nova.compute.manager [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Attaching volume c01a1ee7-47d4-4a17-8927-ab4f2a952d16 to /dev/vdb
Aug 16 09:29:38 user nova-compute[73208]: DEBUG os_brick.utils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:29:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b7a275-953d-451c-b2d7-681064c0d45f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[800ffe14-32c5-463a-8b3d-79935c9414b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f82d6-4428-4359-bee8-a94e7a52215a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4708d68b-107f-4f09-8624-0f3fb4d4f5f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:29:39 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b0997-40c7-4d8e-9259-e12bcdef637b]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG os_brick.utils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Updating existing volume attachment record: 5d3322a9-489a-469d-9c97-1e58075e1ed0 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:29:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:29:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updating instance_info_cache with network_info: [{"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:29:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-6b259ec1-e74b-4255-aedf-685818f23c76" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:29:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:29:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:29:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:29:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:29:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:29:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkpjdnEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:29:49 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:29:49 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:29:49 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37dd4bf-7593-4c6c-a12c-1e47c430608f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:29:49 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d08b58e-9980-42d6-9add-8fc7de5ca22d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16] added
Aug 16 09:29:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b2d874-d67e-45bd-8094-5e64e081fac7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4563eb92-8f42-497e-9d1e-f047aad74834]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkpjdnEt {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkpjdnEt" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[250ce990-5084-456c-b803-75520594ba51]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkpjdnEt'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b222bfd-03ae-4f0f-a43d-b2260b53a855]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[46322d89-c34f-44ae-b4c1-ffaeb1e1e28e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac042b26-d129-4693-8bb7-7c536557ca1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16, portal: 172.16.0.220,3260]
Aug 16 09:29:49 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16, portal: 172.16.0.220,3260] successful.
Aug 16 09:29:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e87f3b-45f7-41fc-b893-74774163336e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a24e2d-7045-4c8d-8b54-7144cca2b05e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 (non-flash)
Aug 16 09:29:49 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e519314d-14ba-4539-8b5a-6c0eb8e4d7ac]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:49 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:29:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:29:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkpjdnEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:29:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:29:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26334623137326662', 'path': '/dev/sde'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:29:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334623137326662', 'path': '/dev/sde'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:29:50 user nova-compute[73208]: DEBUG nova.objects.instance [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid f62bba74-2ef0-46f4-adee-7695e2379018 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:29:50 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:29:50 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:29:50 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:29:50 user nova-compute[73208]:   <serial>c01a1ee7-47d4-4a17-8927-ab4f2a952d16</serial>
Aug 16 09:29:50 user nova-compute[73208]: </disk>
Aug 16 09:29:50 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:29:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:29:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:29:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No VIF found with MAC fa:16:3e:dc:08:41, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:29:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-90da8765-3e34-433c-bb54-2032f9410ba9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.499s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'flavor' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "f62bba74-2ef0-46f4-adee-7695e2379018" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:52 user nova-compute[73208]: INFO nova.compute.manager [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Detaching volume c01a1ee7-47d4-4a17-8927-ab4f2a952d16
Aug 16 09:29:52 user nova-compute[73208]: INFO nova.virt.block_device [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Attempting to driver detach volume c01a1ee7-47d4-4a17-8927-ab4f2a952d16 from mountpoint /dev/vdb
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Attempting to detach device vdb from instance f62bba74-2ef0-46f4-adee-7695e2379018 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:29:52 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:29:52 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:29:52 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:29:52 user nova-compute[73208]:   <serial>c01a1ee7-47d4-4a17-8927-ab4f2a952d16</serial>
Aug 16 09:29:52 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:29:52 user nova-compute[73208]: </disk>
Aug 16 09:29:52 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:29:52 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully detached device vdb from instance f62bba74-2ef0-46f4-adee-7695e2379018 from the persistent domain config.
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f62bba74-2ef0-46f4-adee-7695e2379018 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:29:52 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:29:52 user nova-compute[73208]:   <source dev="/dev/sde"/>
Aug 16 09:29:52 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:29:52 user nova-compute[73208]:   <serial>c01a1ee7-47d4-4a17-8927-ab4f2a952d16</serial>
Aug 16 09:29:52 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:29:52 user nova-compute[73208]: </disk>
Aug 16 09:29:52 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:29:52 user nova-compute[73208]: INFO nova.compute.manager [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Attaching volume e8d169ec-490b-4b7e-a37a-94ecbdf77410 to /dev/vdb
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.utils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[32287238-4b85-4c6f-847b-4d6f52cba1d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c6800e-6ec0-4ff2-baa7-b4b207f29758]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[526bbba0-be7d-4bd3-8477-3f5d18bcabc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[13994770-b3fa-48e3-ad7c-d1222b23d45c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:29:52 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dad328-2756-4f2f-9946-4f03596b153c]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.utils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating existing volume attachment record: ef663826-33f6-4f7b-8265-440d1729a5b3 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178192.7261417, f62bba74-2ef0-46f4-adee-7695e2379018 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f62bba74-2ef0-46f4-adee-7695e2379018 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:29:52 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully detached device vdb from instance f62bba74-2ef0-46f4-adee-7695e2379018 from the live domain config.
Aug 16 09:29:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkpjdnEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:29:52 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[795ef4f7-5a18-463a-96ad-981d0a41fd62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd00af55-1e35-4170-ab55-6cb4da740f33]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:29:52 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:29:52 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:29:52 user nova-compute[73208]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 (non-flash)
Aug 16 09:29:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:29:52 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:29:52 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:29:52 user nova-compute[73208]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 (non-flash)
Aug 16 09:29:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f01f8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16'): ({'sde'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Removing single pathed devices sde {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2a4b5d-e900-4763-97c5-03748e97d4af]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b12b251-30e2-44f9-877c-e13fb4c965b9]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flushing IO for device /dev/sde {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8f2271-002a-46c4-91fb-98ca383beaa3]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d82c8d-7268-4e68-99fe-a4d4d166e059]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2393d34-d86a-4739-9d2b-5bbc3dabe1f2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[038f8b43-264e-4e0f-95bc-ca61bb66d255]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16, portal: 172.16.0.220,3260]
Aug 16 09:29:52 user nova-compute[73208]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16, portal: 172.16.0.220,3260] successful.
Aug 16 09:29:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a1ee7-47d4-4a17-8927-ab4f2a952d16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9cb75b-aba9-4809-8bbe-700e7f7398a6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== disconnect_volume: return (276ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG nova.objects.instance [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid f62bba74-2ef0-46f4-adee-7695e2379018 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:29:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-502ec1b2-c5d7-4e74-9069-c4145bc3c2b9 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:29:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:29:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-0b98df5c-705e-436e-9908-4b399cc0f619 req-c05543ac-da20-4909-8c62-bc26462155d4 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-0b98df5c-705e-436e-9908-4b399cc0f619 req-c05543ac-da20-4909-8c62-bc26462155d4 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing instance network info cache due to event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0b98df5c-705e-436e-9908-4b399cc0f619 req-c05543ac-da20-4909-8c62-bc26462155d4 service nova] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0b98df5c-705e-436e-9908-4b399cc0f619 req-c05543ac-da20-4909-8c62-bc26462155d4 service nova] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-0b98df5c-705e-436e-9908-4b399cc0f619 req-c05543ac-da20-4909-8c62-bc26462155d4 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-0b98df5c-705e-436e-9908-4b399cc0f619 req-c05543ac-da20-4909-8c62-bc26462155d4 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updated VIF entry in instance network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-0b98df5c-705e-436e-9908-4b399cc0f619 req-c05543ac-da20-4909-8c62-bc26462155d4 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0b98df5c-705e-436e-9908-4b399cc0f619 req-c05543ac-da20-4909-8c62-bc26462155d4 service nova] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:08 user nova-compute[73208]: INFO nova.compute.manager [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Shelve offloading
Aug 16 09:30:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d2de738-d514-47fb-b2af-2a5dbd0b3388 req-3b406dfd-42e5-4bb5-a470-9a78754cbdfc service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-unplugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d2de738-d514-47fb-b2af-2a5dbd0b3388 req-3b406dfd-42e5-4bb5-a470-9a78754cbdfc service nova] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d2de738-d514-47fb-b2af-2a5dbd0b3388 req-3b406dfd-42e5-4bb5-a470-9a78754cbdfc service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3d2de738-d514-47fb-b2af-2a5dbd0b3388 req-3b406dfd-42e5-4bb5-a470-9a78754cbdfc service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-3d2de738-d514-47fb-b2af-2a5dbd0b3388 req-3b406dfd-42e5-4bb5-a470-9a78754cbdfc service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] No waiting events found dispatching network-vif-unplugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:30:09 user nova-compute[73208]: WARNING nova.compute.manager [req-3d2de738-d514-47fb-b2af-2a5dbd0b3388 req-3b406dfd-42e5-4bb5-a470-9a78754cbdfc service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received unexpected event network-vif-unplugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 for instance with vm_state active and task_state shelving.
Aug 16 09:30:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance destroyed successfully.
Aug 16 09:30:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:30:10 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance destroyed successfully.
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lazy-loading 'resources' on Instance uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-520207354',display_name='tempest-TestShelveInstance-server-520207354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-520207354',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTxujKSCteZ5P6lR4UwzRys67W8lMq/TyHdhvHBTlgZ+s9EYE4Ik7pvRHc0oNFhtBuedzNM172/eZhL3HuwHksgGZahHrqHdc9j4QckywqYhlcoHYVKroFDwgKNX74Kgg==',key_name='tempest-TestShelveInstance-1927113377',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21041c92f02043e0baa0f6abeadcd78e',ramdisk_id='',reservation_id='r-g3kxydmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1402301442',owner_user_name='tempest-TestShelveInstance-1402301442-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:28:33Z,user_data=None,user_id='f9014d0cab7e416fa4e030653fd4b01d',uuid=aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converting VIF {"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_vif [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33df2ec9-e7, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-8c4a7e27-62cc-4410-86db-9b91c6dd8ba4 req-c492a41a-5995-4c09-8384-3f400a9e22b1 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-8c4a7e27-62cc-4410-86db-9b91c6dd8ba4 req-c492a41a-5995-4c09-8384-3f400a9e22b1 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing instance network info cache due to event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8c4a7e27-62cc-4410-86db-9b91c6dd8ba4 req-c492a41a-5995-4c09-8384-3f400a9e22b1 service nova] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8c4a7e27-62cc-4410-86db-9b91c6dd8ba4 req-c492a41a-5995-4c09-8384-3f400a9e22b1 service nova] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-8c4a7e27-62cc-4410-86db-9b91c6dd8ba4 req-c492a41a-5995-4c09-8384-3f400a9e22b1 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:30:10 user nova-compute[73208]: INFO os_vif [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7')
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWDtyxEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:30:10 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9dd057-fc05-4894-b2e3-1aa98c7bfc02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1e039a-ac71-4343-bf2a-30a3256284ef]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:30:10 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:30:10 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:30:10 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:30:10 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:30:10 user nova-compute[73208]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:30:10 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0640160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ebaf48-67db-4ab1-9c27-45c7e1ff7977]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7316e3-235c-4b78-95d6-e2620b471578]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[88535df5-60ed-48f4-82d2-6f6a4518d85e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[556b2bfa-dc37-4fbe-b4ce-d9d2084b71e7]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[350559fd-5f06-4248-824a-a24233100306]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740493f-0535-49a1-b7aa-13e0b1a8de62]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260]
Aug 16 09:30:10 user nova-compute[73208]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260] successful.
Aug 16 09:30:10 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[202467b5-cdaf-49d1-a674-a105dc5eb899]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] <== disconnect_volume: return (315ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:30:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:30:10 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Deleting instance files /opt/stack/data/nova/instances/aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727_del
Aug 16 09:30:10 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Deletion of /opt/stack/data/nova/instances/aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727_del complete
Aug 16 09:30:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:11 user nova-compute[73208]: DEBUG nova.network.neutron [req-8c4a7e27-62cc-4410-86db-9b91c6dd8ba4 req-c492a41a-5995-4c09-8384-3f400a9e22b1 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updated VIF entry in instance network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:30:11 user nova-compute[73208]: DEBUG nova.network.neutron [req-8c4a7e27-62cc-4410-86db-9b91c6dd8ba4 req-c492a41a-5995-4c09-8384-3f400a9e22b1 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": null, "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-622b4737-2185-433f-8656-81a0488cf84d req-f973c6f5-2cca-419d-a8e1-50c8ad7f5eb1 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-622b4737-2185-433f-8656-81a0488cf84d req-f973c6f5-2cca-419d-a8e1-50c8ad7f5eb1 service nova] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-622b4737-2185-433f-8656-81a0488cf84d req-f973c6f5-2cca-419d-a8e1-50c8ad7f5eb1 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-622b4737-2185-433f-8656-81a0488cf84d req-f973c6f5-2cca-419d-a8e1-50c8ad7f5eb1 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-622b4737-2185-433f-8656-81a0488cf84d req-f973c6f5-2cca-419d-a8e1-50c8ad7f5eb1 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] No waiting events found dispatching network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:30:11 user nova-compute[73208]: WARNING nova.compute.manager [req-622b4737-2185-433f-8656-81a0488cf84d req-f973c6f5-2cca-419d-a8e1-50c8ad7f5eb1 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received unexpected event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 for instance with vm_state active and task_state shelving.
Aug 16 09:30:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8c4a7e27-62cc-4410-86db-9b91c6dd8ba4 req-c492a41a-5995-4c09-8384-3f400a9e22b1 service nova] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:30:12 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Deleted allocations for instance aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727
Aug 16 09:30:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:12 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lazy-loading 'numa_topology' on Instance uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:12 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:30:12 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:30:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ebcf58e0-b975-410b-bae8-711d7a222eb0 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.925s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InZSlpfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:30:16 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:30:16 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:30:16 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8d204c-1389-4fbb-ad34-b4d17aed3836]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:30:16 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[608172f3-532b-427e-b598-d87ad61f5178]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410] added
Aug 16 09:30:16 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f54729c-4383-4ea2-a132-565806bfe96f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fc21a4-f5d5-4b7f-97e4-87495f0fdb03]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v InZSlpfi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v InZSlpfi" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f72dd8-3e27-4775-9708-0bbac854b774]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'InZSlpfi'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62079ac-6530-4b0d-96f3-d7bfe6da3f54]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9daf0-f8c9-4b49-952b-3c0213714f33]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:30:16 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:30:16 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:30:16 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:30:16 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:30:16 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[231d9ef2-9f0b-45e7-97ef-4eea74b08e79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410, portal: 172.16.0.220,3260]
Aug 16 09:30:17 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410, portal: 172.16.0.220,3260] successful.
Aug 16 09:30:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[970ba9b6-75a0-4db2-a4cf-0684cf5f2fc4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d8464-b895-4502-ae55-73df28e816d1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:30:17 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:30:17 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:30:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:30:17 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:30:17 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:30:17 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e048525-0171-4ec6-9025-82d6676ea0d8]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:17 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InZSlpfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23864613834343038', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864613834343038', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'flavor' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:30:18 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:30:18 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:30:18 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:30:18 user nova-compute[73208]:   <serial>e8d169ec-490b-4b7e-a37a-94ecbdf77410</serial>
Aug 16 09:30:18 user nova-compute[73208]: </disk>
Aug 16 09:30:18 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No VIF found with MAC fa:16:3e:13:93:22, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:30:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f50774a2-4c20-4c01-bbce-c0d48a56b146 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.396s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:19 user nova-compute[73208]: INFO nova.compute.manager [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Rescuing
Aug 16 09:30:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:30:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquired lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:30:19 user nova-compute[73208]: DEBUG nova.network.neutron [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:30:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Releasing lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:30:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-d14a3a93-41e1-497b-85c8-575b228c5588 req-497b986e-d63c-4e3a-9337-e54571a7e122 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d14a3a93-41e1-497b-85c8-575b228c5588 req-497b986e-d63c-4e3a-9337-e54571a7e122 service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d14a3a93-41e1-497b-85c8-575b228c5588 req-497b986e-d63c-4e3a-9337-e54571a7e122 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d14a3a93-41e1-497b-85c8-575b228c5588 req-497b986e-d63c-4e3a-9337-e54571a7e122 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-d14a3a93-41e1-497b-85c8-575b228c5588 req-497b986e-d63c-4e3a-9337-e54571a7e122 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:30:21 user nova-compute[73208]: WARNING nova.compute.manager [req-d14a3a93-41e1-497b-85c8-575b228c5588 req-497b986e-d63c-4e3a-9337-e54571a7e122 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state active and task_state rescuing.
Aug 16 09:30:21 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance destroyed successfully.
Aug 16 09:30:21 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Attempting a stable device rescue
Aug 16 09:30:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73208) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance directory exists: not creating {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 09:30:21 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Creating image(s)
Aug 16 09:30:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG nova.objects.instance [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'trusted_certs' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "e7b820dd8dd2419895dc62e094b14ed16ca01469" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "e7b820dd8dd2419895dc62e094b14ed16ca01469" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-2a978e3f-36b6-4c6f-b05f-e017658247a6 req-f2e5e9fa-2c5d-4857-86f5-9cb9ff827bd3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2a978e3f-36b6-4c6f-b05f-e017658247a6 req-f2e5e9fa-2c5d-4857-86f5-9cb9ff827bd3 service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2a978e3f-36b6-4c6f-b05f-e017658247a6 req-f2e5e9fa-2c5d-4857-86f5-9cb9ff827bd3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2a978e3f-36b6-4c6f-b05f-e017658247a6 req-f2e5e9fa-2c5d-4857-86f5-9cb9ff827bd3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-2a978e3f-36b6-4c6f-b05f-e017658247a6 req-f2e5e9fa-2c5d-4857-86f5-9cb9ff827bd3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:30:23 user nova-compute[73208]: WARNING nova.compute.manager [req-2a978e3f-36b6-4c6f-b05f-e017658247a6 req-f2e5e9fa-2c5d-4857-86f5-9cb9ff827bd3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state active and task_state rescuing.
Aug 16 09:30:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469.part --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG nova.virt.images [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] 04bc147d-5090-40d1-8e9b-12c93286307b was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469.part /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469.part /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469.converted" returned: 0 in 0.547s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "e7b820dd8dd2419895dc62e094b14ed16ca01469" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.377s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "e7b820dd8dd2419895dc62e094b14ed16ca01469" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "e7b820dd8dd2419895dc62e094b14ed16ca01469" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469 --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469,backing_fmt=raw /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469,backing_fmt=raw /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue" returned: 0 in 0.074s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "e7b820dd8dd2419895dc62e094b14ed16ca01469" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'migration_context' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Start _get_guest_xml network_info=[{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "vif_mac": "fa:16:3e:13:93:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '04bc147d-5090-40d1-8e9b-12c93286307b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'ef663826-33f6-4f7b-8265-440d1729a5b3', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InZSlpfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'af45d645-fd93-4e44-9700-018b121659c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8d169ec-490b-4b7e-a37a-94ecbdf77410', 'serial': 'e8d169ec-490b-4b7e-a37a-94ecbdf77410'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'resources' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'numa_topology' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:24 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:30:24 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'vcpu_model' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178209.44061, aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:30:24 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] VM Stopped (Lifecycle Event)
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InZSlpfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:30:24 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:30:24 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:30:24 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0cf01367-6dfa-4b7d-b0c5-e6cb6e46ec89 None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1cc9a8-6e3a-407d-9fde-489a335c87f5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = InZSlpfi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 09:30:24 user nova-compute[73208]: node.name = iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410
Aug 16 09:30:24 user nova-compute[73208]: node.tpgt = -1
Aug 16 09:30:24 user nova-compute[73208]: node.startup = automatic
Aug 16 09:30:24 user nova-compute[73208]: node.leading_login = No
Aug 16 09:30:24 user nova-compute[73208]: iface.iscsi_ifacename = default
Aug 16 09:30:24 user nova-compute[73208]: iface.net_ifacename = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.ipaddress = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.prefix_len = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.hwaddress = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.transport_name = tcp
Aug 16 09:30:24 user nova-compute[73208]: iface.initiatorname = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.state = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.vlan_id = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.vlan_priority = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.vlan_state = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.iface_num = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.mtu = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.port = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.bootproto = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.subnet_mask = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.gateway = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.dhcp_alt_client_id = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.dhcp_dns = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.dhcp_learn_iqn = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.dhcp_vendor_id_state = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.dhcp_vendor_id = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.dhcp_slp_da = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.fragmentation = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.gratuitous_arp = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.incoming_forwarding = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.tos_state = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.tos = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.ttl = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.delayed_ack = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.tcp_nagle = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.tcp_wsf_state = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.tcp_wsf = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.tcp_timer_scale = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.tcp_timestamp = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.redirect = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.def_task_mgmt_timeout = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.header_digest = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.data_digest = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.immediate_data = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.initial_r2t = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.data_seq_inorder = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.data_pdu_inorder = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.erl = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.max_receive_data_len = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.first_burst_len = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.max_outstanding_r2t = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.max_burst_len = 0
Aug 16 09:30:24 user nova-compute[73208]: iface.chap_auth = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.bidi_chap = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.strict_login_compliance = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.discovery_auth = <empty>
Aug 16 09:30:24 user nova-compute[73208]: iface.discovery_logout = <empty>
Aug 16 09:30:24 user nova-compute[73208]: node.discovery_address = <empty>
Aug 16 09:30:24 user nova-compute[73208]: node.discovery_port = 0
Aug 16 09:30:24 user nova-compute[73208]: node.discovery_type = static
Aug 16 09:30:24 user nova-compute[73208]: node.session.initial_cmdsn = 0
Aug 16 09:30:24 user nova-compute[73208]: node.session.initial_login_retry_max = 8
Aug 16 09:30:24 user nova-compute[73208]: node.session.xmit_thread_priority = -20
Aug 16 09:30:24 user nova-compute[73208]: node.session.cmds_max = 128
Aug 16 09:30:24 user nova-compute[73208]: node.session.queue_depth = 32
Aug 16 09:30:24 user nova-compute[73208]: node.session.nr_sessions = 1
Aug 16 09:30:24 user nova-compute[73208]: node.session.auth.authmethod = CHAP
Aug 16 09:30:24 user nova-compute[73208]: node.session.auth.username = InZSlpfi
Aug 16 09:30:24 user nova-compute[73208]: node.session.auth.password = ***
Aug 16 09:30:24 user nova-compute[73208]: node.session.auth.username_in = <empty>
Aug 16 09:30:24 user nova-compute[73208]: node.session.auth.password_in = <empty>
Aug 16 09:30:24 user nova-compute[73208]: node.session.auth.chap_algs = MD5
Aug 16 09:30:24 user nova-compute[73208]: node.session.timeo.replacement_timeout = 120
Aug 16 09:30:24 user nova-compute[73208]: node.session.err_timeo.abort_timeout = 15
Aug 16 09:30:24 user nova-compute[73208]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 09:30:24 user nova-compute[73208]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 09:30:24 user nova-compute[73208]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.FastAbort = Yes
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.InitialR2T = No
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.ImmediateData = Yes
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.MaxConnections = 1
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 09:30:24 user nova-compute[73208]: node.session.iscsi.ERL = 0
Aug 16 09:30:24 user nova-compute[73208]: node.session.scan = manual
Aug 16 09:30:24 user nova-compute[73208]: node.session.reopen_max = 0
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].address = 172.16.0.220
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].port = 3260
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].startup = manual
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].tcp.window_size = 524288
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].tcp.type_of_service = 0
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].timeo.logout_timeout = 15
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].timeo.login_timeout = 15
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].timeo.auth_timeout = 45
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].iscsi.DataDigest = None
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].iscsi.IFMarker = No
Aug 16 09:30:24 user nova-compute[73208]: node.conn[0].iscsi.OFMarker = No
Aug 16 09:30:24 user nova-compute[73208]: # END RECORD
Aug 16 09:30:24 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ebe53b-cc66-4cbf-84c0-ee2cd8354990]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ff97cd-f58a-414b-a17a-875b315eacdc]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v InZSlpfi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v InZSlpfi" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bfee44-26fe-40c0-a7c6-e79bf3a6f65a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'InZSlpfi'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59c76ee-e4be-414d-a195-42a0e078e8d6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d3ad9e-74f9-4c6e-9388-f314a0a37adf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:30:24 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:30:24 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:30:24 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:30:24 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:30:24 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:30:24 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] HCTL ('35', '0', '0', 0) found on session 44 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45f1608-c69e-4cae-85ec-cf32d7120583]: (4, ('0 0 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Searching for a device in session 44 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InZSlpfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23864613834343038', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864613834343038', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-919633964',display_name='tempest-ServerStableDeviceRescueTest-server-919633964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-919633964',id=35,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0YU4/+Pf8WDx9dx6xIEfPvH/hVAaKk5212Crjq+ypMbUf9I0vNMOG02Jqpqdo7FDE0YgmrXTqjccKYYVYDAQ1JC152XLZ6tzpbdqjRE4VfzMz/CT8MRHCCY2U4P0Lk7g==',key_name='tempest-keypair-835774011',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1964699a248443e68e8ccd09b454c668',ramdisk_id='',reservation_id='r-d674ii0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-513168018',owner_user_name='tempest-ServerStableDeviceRescueTest-513168018-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a31cfa72d13427b896669c9ba5f0832',uuid=af45d645-fd93-4e44-9700-018b121659c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "vif_mac": "fa:16:3e:13:93:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Converting VIF {"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "vif_mac": "fa:16:3e:13:93:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:93:22,bridge_name='br-int',has_traffic_filtering=True,id=8b20c094-a0f7-4c34-a98d-d2938c3ebb28,network=Network(ac16d50f-8088-4e9a-87af-e3cddb7e0ce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b20c094-a0') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'pci_devices' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:30:24 user nova-compute[73208]:   <uuid>af45d645-fd93-4e44-9700-018b121659c1</uuid>
Aug 16 09:30:24 user nova-compute[73208]:   <name>instance-00000023</name>
Aug 16 09:30:24 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:30:24 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:30:24 user nova-compute[73208]:   <metadata>
Aug 16 09:30:24 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:30:24 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:30:24 user nova-compute[73208]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-919633964</nova:name>
Aug 16 09:30:24 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:30:24</nova:creationTime>
Aug 16 09:30:24 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:30:24 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:30:24 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:30:24 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:30:24 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:30:24 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:30:24 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:30:24 user nova-compute[73208]:       <nova:owner>
Aug 16 09:30:24 user nova-compute[73208]:         <nova:user uuid="5a31cfa72d13427b896669c9ba5f0832">tempest-ServerStableDeviceRescueTest-513168018-project-member</nova:user>
Aug 16 09:30:24 user nova-compute[73208]:         <nova:project uuid="1964699a248443e68e8ccd09b454c668">tempest-ServerStableDeviceRescueTest-513168018</nova:project>
Aug 16 09:30:24 user nova-compute[73208]:       </nova:owner>
Aug 16 09:30:24 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:30:24 user nova-compute[73208]:       <nova:ports>
Aug 16 09:30:24 user nova-compute[73208]:         <nova:port uuid="8b20c094-a0f7-4c34-a98d-d2938c3ebb28">
Aug 16 09:30:24 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 09:30:24 user nova-compute[73208]:         </nova:port>
Aug 16 09:30:24 user nova-compute[73208]:       </nova:ports>
Aug 16 09:30:24 user nova-compute[73208]:     </nova:instance>
Aug 16 09:30:24 user nova-compute[73208]:   </metadata>
Aug 16 09:30:24 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:30:24 user nova-compute[73208]:     <system>
Aug 16 09:30:24 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:30:24 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:30:24 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:30:24 user nova-compute[73208]:       <entry name="serial">af45d645-fd93-4e44-9700-018b121659c1</entry>
Aug 16 09:30:24 user nova-compute[73208]:       <entry name="uuid">af45d645-fd93-4e44-9700-018b121659c1</entry>
Aug 16 09:30:24 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:30:24 user nova-compute[73208]:     </system>
Aug 16 09:30:24 user nova-compute[73208]:   </sysinfo>
Aug 16 09:30:24 user nova-compute[73208]:   <os>
Aug 16 09:30:24 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:30:24 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:30:24 user nova-compute[73208]:   </os>
Aug 16 09:30:24 user nova-compute[73208]:   <features>
Aug 16 09:30:24 user nova-compute[73208]:     <acpi/>
Aug 16 09:30:24 user nova-compute[73208]:     <apic/>
Aug 16 09:30:24 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:30:24 user nova-compute[73208]:   </features>
Aug 16 09:30:24 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:30:24 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:30:24 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:30:24 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:30:24 user nova-compute[73208]:   </clock>
Aug 16 09:30:24 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:30:24 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:30:24 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:30:24 user nova-compute[73208]:   </cpu>
Aug 16 09:30:24 user nova-compute[73208]:   <devices>
Aug 16 09:30:24 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:30:24 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:30:24 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk"/>
Aug 16 09:30:24 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:30:24 user nova-compute[73208]:     </disk>
Aug 16 09:30:24 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:30:24 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:30:24 user nova-compute[73208]:       <source dev="/dev/sdd"/>
Aug 16 09:30:24 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:30:24 user nova-compute[73208]:       <serial>e8d169ec-490b-4b7e-a37a-94ecbdf77410</serial>
Aug 16 09:30:24 user nova-compute[73208]:     </disk>
Aug 16 09:30:24 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:30:24 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:30:24 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue"/>
Aug 16 09:30:24 user nova-compute[73208]:       <target dev="vdc" bus="virtio"/>
Aug 16 09:30:24 user nova-compute[73208]:       <boot order="1"/>
Aug 16 09:30:24 user nova-compute[73208]:     </disk>
Aug 16 09:30:24 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:30:24 user nova-compute[73208]:       <mac address="fa:16:3e:13:93:22"/>
Aug 16 09:30:24 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:30:24 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:30:24 user nova-compute[73208]:       <target dev="tap8b20c094-a0"/>
Aug 16 09:30:24 user nova-compute[73208]:     </interface>
Aug 16 09:30:24 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:30:24 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/console.log" append="off"/>
Aug 16 09:30:24 user nova-compute[73208]:     </serial>
Aug 16 09:30:24 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:30:24 user nova-compute[73208]:     <video>
Aug 16 09:30:24 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:30:24 user nova-compute[73208]:     </video>
Aug 16 09:30:24 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:30:24 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:30:24 user nova-compute[73208]:     </rng>
Aug 16 09:30:24 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:30:24 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:30:24 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:30:24 user nova-compute[73208]:     </memballoon>
Aug 16 09:30:24 user nova-compute[73208]:   </devices>
Aug 16 09:30:24 user nova-compute[73208]: </domain>
Aug 16 09:30:24 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:30:24 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance destroyed successfully.
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:30:24 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] No VIF found with MAC fa:16:3e:13:93:22, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:30:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-9aab4d27-3f59-407a-b41f-a5237e189c6d req-6f081e36-5694-4f73-80f0-937c9da4a4af service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9aab4d27-3f59-407a-b41f-a5237e189c6d req-6f081e36-5694-4f73-80f0-937c9da4a4af service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9aab4d27-3f59-407a-b41f-a5237e189c6d req-6f081e36-5694-4f73-80f0-937c9da4a4af service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9aab4d27-3f59-407a-b41f-a5237e189c6d req-6f081e36-5694-4f73-80f0-937c9da4a4af service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-9aab4d27-3f59-407a-b41f-a5237e189c6d req-6f081e36-5694-4f73-80f0-937c9da4a4af service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:30:26 user nova-compute[73208]: WARNING nova.compute.manager [req-9aab4d27-3f59-407a-b41f-a5237e189c6d req-6f081e36-5694-4f73-80f0-937c9da4a4af service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state active and task_state rescuing.
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-e65cf0e0-1399-47fd-a076-00a94beb8bc2 req-e1fe03b2-c525-4790-92f7-27dba1dbaf1e service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e65cf0e0-1399-47fd-a076-00a94beb8bc2 req-e1fe03b2-c525-4790-92f7-27dba1dbaf1e service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e65cf0e0-1399-47fd-a076-00a94beb8bc2 req-e1fe03b2-c525-4790-92f7-27dba1dbaf1e service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e65cf0e0-1399-47fd-a076-00a94beb8bc2 req-e1fe03b2-c525-4790-92f7-27dba1dbaf1e service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-e65cf0e0-1399-47fd-a076-00a94beb8bc2 req-e1fe03b2-c525-4790-92f7-27dba1dbaf1e service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:30:28 user nova-compute[73208]: WARNING nova.compute.manager [req-e65cf0e0-1399-47fd-a076-00a94beb8bc2 req-e1fe03b2-c525-4790-92f7-27dba1dbaf1e service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state active and task_state rescuing.
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for af45d645-fd93-4e44-9700-018b121659c1 due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178228.8086512, af45d645-fd93-4e44-9700-018b121659c1 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:30:28 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] VM Resumed (Lifecycle Event)
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-04f08db1-adaa-4802-b13a-6d81b42386c3 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:30:28 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178228.8099346, af45d645-fd93-4e44-9700-018b121659c1 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:30:28 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] VM Started (Lifecycle Event)
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:30:28 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:30:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:29 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:29 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:29 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:30:29 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:30:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8139MB free_disk=25.058021545410156GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance af45d645-fd93-4e44-9700-018b121659c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance abbf98e1-d609-49ab-8b7f-6b8d57f2718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f62bba74-2ef0-46f4-adee-7695e2379018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:30:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:35 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:30:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:36 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:37 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:30:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:30:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:30:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:30:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:30:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Updating instance_info_cache with network_info: [{"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-0b6a305b-662e-4498-ac23-99ccfe1fca4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:30:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:30:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "f62bba74-2ef0-46f4-adee-7695e2379018" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:42 user nova-compute[73208]: INFO nova.compute.manager [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Terminating instance
Aug 16 09:30:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:30:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Instance destroyed successfully.
Aug 16 09:30:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'resources' on Instance uuid f62bba74-2ef0-46f4-adee-7695e2379018 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48433274',display_name='tempest-AttachVolumeNegativeTest-server-48433274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48433274',id=38,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZDwz4szeX4201J5weat99xGwdsm3qfIiNdV188dRQl55qR6sskJ3mSV+gorCNTiUYe78XGuYW5t5UWRl6xle2m+3OesEfgI27mheK84ak3u8HtcesrowPpa8KVvPYDrA==',key_name='tempest-keypair-517959847',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:27:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-nwexhqz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=f62bba74-2ef0-46f4-adee-7695e2379018,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "address": "fa:16:3e:dc:08:41", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8300e258-72", "ovs_interfaceid": "8300e258-72cb-4f0a-bc99-99f0f3a0dfc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:08:41,bridge_name='br-int',has_traffic_filtering=True,id=8300e258-72cb-4f0a-bc99-99f0f3a0dfc3,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8300e258-72') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG os_vif [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:08:41,bridge_name='br-int',has_traffic_filtering=True,id=8300e258-72cb-4f0a-bc99-99f0f3a0dfc3,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8300e258-72') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8300e258-72, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:30:43 user nova-compute[73208]: INFO os_vif [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:08:41,bridge_name='br-int',has_traffic_filtering=True,id=8300e258-72cb-4f0a-bc99-99f0f3a0dfc3,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8300e258-72')
Aug 16 09:30:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Deleting instance files /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018_del
Aug 16 09:30:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Deletion of /opt/stack/data/nova/instances/f62bba74-2ef0-46f4-adee-7695e2379018_del complete
Aug 16 09:30:43 user nova-compute[73208]: INFO nova.compute.manager [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 09:30:43 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:30:43 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:30:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-1c969deb-1db3-4df3-aa00-68cda9aba159 req-5f976db4-2fe2-4209-aa6c-feed19dec9bb service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Received event network-vif-deleted-8300e258-72cb-4f0a-bc99-99f0f3a0dfc3 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:44 user nova-compute[73208]: INFO nova.compute.manager [req-1c969deb-1db3-4df3-aa00-68cda9aba159 req-5f976db4-2fe2-4209-aa6c-feed19dec9bb service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Neutron deleted interface 8300e258-72cb-4f0a-bc99-99f0f3a0dfc3; detaching it from the instance and deleting it from the info cache
Aug 16 09:30:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-1c969deb-1db3-4df3-aa00-68cda9aba159 req-5f976db4-2fe2-4209-aa6c-feed19dec9bb service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:44 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-1c969deb-1db3-4df3-aa00-68cda9aba159 req-5f976db4-2fe2-4209-aa6c-feed19dec9bb service nova] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Detach interface failed, port_id=8300e258-72cb-4f0a-bc99-99f0f3a0dfc3, reason: Instance f62bba74-2ef0-46f4-adee-7695e2379018 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:30:44 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Took 1.06 seconds to deallocate network for instance.
Aug 16 09:30:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:44 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:30:44 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:45 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Deleted allocations for instance f62bba74-2ef0-46f4-adee-7695e2379018
Aug 16 09:30:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1d91ad4d-63d3-4720-ae5a-5e1fc313f834 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "f62bba74-2ef0-46f4-adee-7695e2379018" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.416s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:30:45 user nova-compute[73208]: INFO nova.compute.claims [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Claim successful on node user
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:30:45 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:30:45 user nova-compute[73208]: DEBUG nova.policy [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9e580b08b3c4aedac129af68b52bc1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8034f56136441b39297e22b45bb45bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:30:46 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Creating image(s)
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "/opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "/opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk 1073741824" returned: 0 in 0.060s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.231s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Successfully created port: 3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Cannot resize image /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'migration_context' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Ensure instance console log exists: /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:47 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Successfully updated port: 3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:30:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:30:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquired lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:30:47 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:30:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0be20f6c-1a0a-4254-91fb-e6847d094c0d req-61d082eb-0c02-481e-ab42-456205216fd9 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received event network-changed-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-0be20f6c-1a0a-4254-91fb-e6847d094c0d req-61d082eb-0c02-481e-ab42-456205216fd9 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Refreshing instance network info cache due to event network-changed-3924f9e2-9ac8-4f12-97b4-49527111727e. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:30:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0be20f6c-1a0a-4254-91fb-e6847d094c0d req-61d082eb-0c02-481e-ab42-456205216fd9 service nova] Acquiring lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:30:47 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating instance_info_cache with network_info: [{"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Releasing lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Instance network_info: |[{"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0be20f6c-1a0a-4254-91fb-e6847d094c0d req-61d082eb-0c02-481e-ab42-456205216fd9 service nova] Acquired lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-0be20f6c-1a0a-4254-91fb-e6847d094c0d req-61d082eb-0c02-481e-ab42-456205216fd9 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Refreshing network info cache for port 3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Start _get_guest_xml network_info=[{"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:30:48 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:30:48 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1032232702',display_name='tempest-SnapshotDataIntegrityTests-server-1032232702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1032232702',id=40,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvg8mmaEklLVytWliF0azBRQqVdVoQZTY6FA5pK9oIgTUZore3DQot/n/kVQ8VQmpEzybpn1JjXSiqH2lU0sysgLWfbcRBD3qLkypq39kWTn6CMIZ3e0KrZik8QLrjAg==',key_name='tempest-keypair-1559570417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8034f56136441b39297e22b45bb45bb',ramdisk_id='',reservation_id='r-8dywigvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1282605912',owner_user_name='tempest-SnapshotDataIntegrityTests-1282605912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9e580b08b3c4aedac129af68b52bc1d',uuid=f5067d00-0cd2-40f2-875f-577760762123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Converting VIF {"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b5:ea,bridge_name='br-int',has_traffic_filtering=True,id=3924f9e2-9ac8-4f12-97b4-49527111727e,network=Network(25b67f1b-0251-42a3-938d-da8bbc0470af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3924f9e2-9a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'pci_devices' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:30:48 user nova-compute[73208]:   <uuid>f5067d00-0cd2-40f2-875f-577760762123</uuid>
Aug 16 09:30:48 user nova-compute[73208]:   <name>instance-00000028</name>
Aug 16 09:30:48 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:30:48 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:30:48 user nova-compute[73208]:   <metadata>
Aug 16 09:30:48 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:30:48 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:30:48 user nova-compute[73208]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1032232702</nova:name>
Aug 16 09:30:48 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:30:48</nova:creationTime>
Aug 16 09:30:48 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:30:48 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:30:48 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:30:48 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:30:48 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:30:48 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:30:48 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:30:48 user nova-compute[73208]:       <nova:owner>
Aug 16 09:30:48 user nova-compute[73208]:         <nova:user uuid="c9e580b08b3c4aedac129af68b52bc1d">tempest-SnapshotDataIntegrityTests-1282605912-project-member</nova:user>
Aug 16 09:30:48 user nova-compute[73208]:         <nova:project uuid="f8034f56136441b39297e22b45bb45bb">tempest-SnapshotDataIntegrityTests-1282605912</nova:project>
Aug 16 09:30:48 user nova-compute[73208]:       </nova:owner>
Aug 16 09:30:48 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:30:48 user nova-compute[73208]:       <nova:ports>
Aug 16 09:30:48 user nova-compute[73208]:         <nova:port uuid="3924f9e2-9ac8-4f12-97b4-49527111727e">
Aug 16 09:30:48 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 09:30:48 user nova-compute[73208]:         </nova:port>
Aug 16 09:30:48 user nova-compute[73208]:       </nova:ports>
Aug 16 09:30:48 user nova-compute[73208]:     </nova:instance>
Aug 16 09:30:48 user nova-compute[73208]:   </metadata>
Aug 16 09:30:48 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:30:48 user nova-compute[73208]:     <system>
Aug 16 09:30:48 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:30:48 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:30:48 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:30:48 user nova-compute[73208]:       <entry name="serial">f5067d00-0cd2-40f2-875f-577760762123</entry>
Aug 16 09:30:48 user nova-compute[73208]:       <entry name="uuid">f5067d00-0cd2-40f2-875f-577760762123</entry>
Aug 16 09:30:48 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:30:48 user nova-compute[73208]:     </system>
Aug 16 09:30:48 user nova-compute[73208]:   </sysinfo>
Aug 16 09:30:48 user nova-compute[73208]:   <os>
Aug 16 09:30:48 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:30:48 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:30:48 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:30:48 user nova-compute[73208]:   </os>
Aug 16 09:30:48 user nova-compute[73208]:   <features>
Aug 16 09:30:48 user nova-compute[73208]:     <acpi/>
Aug 16 09:30:48 user nova-compute[73208]:     <apic/>
Aug 16 09:30:48 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:30:48 user nova-compute[73208]:   </features>
Aug 16 09:30:48 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:30:48 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:30:48 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:30:48 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:30:48 user nova-compute[73208]:   </clock>
Aug 16 09:30:48 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:30:48 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:30:48 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:30:48 user nova-compute[73208]:   </cpu>
Aug 16 09:30:48 user nova-compute[73208]:   <devices>
Aug 16 09:30:48 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:30:48 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:30:48 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk"/>
Aug 16 09:30:48 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:30:48 user nova-compute[73208]:     </disk>
Aug 16 09:30:48 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:30:48 user nova-compute[73208]:       <mac address="fa:16:3e:0e:b5:ea"/>
Aug 16 09:30:48 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:30:48 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:30:48 user nova-compute[73208]:       <target dev="tap3924f9e2-9a"/>
Aug 16 09:30:48 user nova-compute[73208]:     </interface>
Aug 16 09:30:48 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:30:48 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/console.log" append="off"/>
Aug 16 09:30:48 user nova-compute[73208]:     </serial>
Aug 16 09:30:48 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:30:48 user nova-compute[73208]:     <video>
Aug 16 09:30:48 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:30:48 user nova-compute[73208]:     </video>
Aug 16 09:30:48 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:30:48 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:30:48 user nova-compute[73208]:     </rng>
Aug 16 09:30:48 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:30:48 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:30:48 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:30:48 user nova-compute[73208]:     </memballoon>
Aug 16 09:30:48 user nova-compute[73208]:   </devices>
Aug 16 09:30:48 user nova-compute[73208]: </domain>
Aug 16 09:30:48 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1032232702',display_name='tempest-SnapshotDataIntegrityTests-server-1032232702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1032232702',id=40,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvg8mmaEklLVytWliF0azBRQqVdVoQZTY6FA5pK9oIgTUZore3DQot/n/kVQ8VQmpEzybpn1JjXSiqH2lU0sysgLWfbcRBD3qLkypq39kWTn6CMIZ3e0KrZik8QLrjAg==',key_name='tempest-keypair-1559570417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8034f56136441b39297e22b45bb45bb',ramdisk_id='',reservation_id='r-8dywigvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1282605912',owner_user_name='tempest-SnapshotDataIntegrityTests-1282605912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9e580b08b3c4aedac129af68b52bc1d',uuid=f5067d00-0cd2-40f2-875f-577760762123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Converting VIF {"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b5:ea,bridge_name='br-int',has_traffic_filtering=True,id=3924f9e2-9ac8-4f12-97b4-49527111727e,network=Network(25b67f1b-0251-42a3-938d-da8bbc0470af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3924f9e2-9a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG os_vif [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b5:ea,bridge_name='br-int',has_traffic_filtering=True,id=3924f9e2-9ac8-4f12-97b4-49527111727e,network=Network(25b67f1b-0251-42a3-938d-da8bbc0470af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3924f9e2-9a') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3924f9e2-9a, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3924f9e2-9a, col_values=(('external_ids', {'iface-id': '3924f9e2-9ac8-4f12-97b4-49527111727e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:b5:ea', 'vm-uuid': 'f5067d00-0cd2-40f2-875f-577760762123'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:48 user nova-compute[73208]: INFO os_vif [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b5:ea,bridge_name='br-int',has_traffic_filtering=True,id=3924f9e2-9ac8-4f12-97b4-49527111727e,network=Network(25b67f1b-0251-42a3-938d-da8bbc0470af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3924f9e2-9a')
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No VIF found with MAC fa:16:3e:0e:b5:ea, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-0be20f6c-1a0a-4254-91fb-e6847d094c0d req-61d082eb-0c02-481e-ab42-456205216fd9 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updated VIF entry in instance network info cache for port 3924f9e2-9ac8-4f12-97b4-49527111727e. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-0be20f6c-1a0a-4254-91fb-e6847d094c0d req-61d082eb-0c02-481e-ab42-456205216fd9 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating instance_info_cache with network_info: [{"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:30:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0be20f6c-1a0a-4254-91fb-e6847d094c0d req-61d082eb-0c02-481e-ab42-456205216fd9 service nova] Releasing lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:30:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-8e20da9b-407f-46cc-85fa-206e98c55014 req-944633ee-c0b4-48c7-b3a1-06c9ce773596 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received event network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8e20da9b-407f-46cc-85fa-206e98c55014 req-944633ee-c0b4-48c7-b3a1-06c9ce773596 service nova] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8e20da9b-407f-46cc-85fa-206e98c55014 req-944633ee-c0b4-48c7-b3a1-06c9ce773596 service nova] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8e20da9b-407f-46cc-85fa-206e98c55014 req-944633ee-c0b4-48c7-b3a1-06c9ce773596 service nova] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-8e20da9b-407f-46cc-85fa-206e98c55014 req-944633ee-c0b4-48c7-b3a1-06c9ce773596 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] No waiting events found dispatching network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:30:50 user nova-compute[73208]: WARNING nova.compute.manager [req-8e20da9b-407f-46cc-85fa-206e98c55014 req-944633ee-c0b4-48c7-b3a1-06c9ce773596 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received unexpected event network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e for instance with vm_state building and task_state spawning.
Aug 16 09:30:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178251.9310715, f5067d00-0cd2-40f2-875f-577760762123 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:30:51 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] VM Resumed (Lifecycle Event)
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:30:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: f5067d00-0cd2-40f2-875f-577760762123] Instance spawned successfully.
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:30:51 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:30:51 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178251.9356756, f5067d00-0cd2-40f2-875f-577760762123 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:30:51 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] VM Started (Lifecycle Event)
Aug 16 09:30:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:30:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:30:52 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:30:52 user nova-compute[73208]: INFO nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 16 09:30:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:30:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-705299cb-9088-4189-9c8c-1924e76bae25 req-eb4cade8-e1d4-4f5b-8e0b-937546473e6d service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received event network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:30:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-705299cb-9088-4189-9c8c-1924e76bae25 req-eb4cade8-e1d4-4f5b-8e0b-937546473e6d service nova] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:30:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-705299cb-9088-4189-9c8c-1924e76bae25 req-eb4cade8-e1d4-4f5b-8e0b-937546473e6d service nova] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:30:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-705299cb-9088-4189-9c8c-1924e76bae25 req-eb4cade8-e1d4-4f5b-8e0b-937546473e6d service nova] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-705299cb-9088-4189-9c8c-1924e76bae25 req-eb4cade8-e1d4-4f5b-8e0b-937546473e6d service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] No waiting events found dispatching network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:30:52 user nova-compute[73208]: WARNING nova.compute.manager [req-705299cb-9088-4189-9c8c-1924e76bae25 req-eb4cade8-e1d4-4f5b-8e0b-937546473e6d service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received unexpected event network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e for instance with vm_state building and task_state spawning.
Aug 16 09:30:52 user nova-compute[73208]: INFO nova.compute.manager [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Took 6.85 seconds to build instance.
Aug 16 09:30:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d52f9047-4b47-4be8-b55c-fb877c3db8ae tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.943s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:30:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:30:58 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178243.5497537, f62bba74-2ef0-46f4-adee-7695e2379018 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:30:58 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] VM Stopped (Lifecycle Event)
Aug 16 09:30:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f95cdb3c-99c4-459d-b516-6b402063fa45 None None] [instance: f62bba74-2ef0-46f4-adee-7695e2379018] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:31:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:16 user nova-compute[73208]: INFO nova.compute.manager [None req-ba08a9e2-d6a4-4214-888c-e2b9149bd485 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Unrescuing
Aug 16 09:31:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ba08a9e2-d6a4-4214-888c-e2b9149bd485 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:31:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ba08a9e2-d6a4-4214-888c-e2b9149bd485 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquired lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:31:16 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ba08a9e2-d6a4-4214-888c-e2b9149bd485 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ba08a9e2-d6a4-4214-888c-e2b9149bd485 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updating instance_info_cache with network_info: [{"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ba08a9e2-d6a4-4214-888c-e2b9149bd485 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Releasing lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ba08a9e2-d6a4-4214-888c-e2b9149bd485 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'flavor' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-6229a6a9-4a3f-4ab7-b307-7ce719d48f03 req-a7743c8f-8ae4-4ab8-b810-01d36f053f04 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6229a6a9-4a3f-4ab7-b307-7ce719d48f03 req-a7743c8f-8ae4-4ab8-b810-01d36f053f04 service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6229a6a9-4a3f-4ab7-b307-7ce719d48f03 req-a7743c8f-8ae4-4ab8-b810-01d36f053f04 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6229a6a9-4a3f-4ab7-b307-7ce719d48f03 req-a7743c8f-8ae4-4ab8-b810-01d36f053f04 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-6229a6a9-4a3f-4ab7-b307-7ce719d48f03 req-a7743c8f-8ae4-4ab8-b810-01d36f053f04 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:31:17 user nova-compute[73208]: WARNING nova.compute.manager [req-6229a6a9-4a3f-4ab7-b307-7ce719d48f03 req-a7743c8f-8ae4-4ab8-b810-01d36f053f04 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:31:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:18 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance destroyed successfully.
Aug 16 09:31:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG nova.compute.manager [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG nova.compute.manager [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:31:19 user nova-compute[73208]: WARNING nova.compute.manager [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:31:19 user nova-compute[73208]: DEBUG nova.compute.manager [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:19 user nova-compute[73208]: DEBUG nova.compute.manager [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:31:19 user nova-compute[73208]: WARNING nova.compute.manager [req-759c1370-f24f-4bf3-b9c2-53ab1f4c6d30 req-a67b867b-860e-49e0-a683-dc21974f445d service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:31:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for abbf98e1-d609-49ab-8b7f-6b8d57f2718a due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178281.698352, abbf98e1-d609-49ab-8b7f-6b8d57f2718a => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:31:21 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] VM Resumed (Lifecycle Event)
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ba08a9e2-d6a4-4214-888c-e2b9149bd485 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:31:21 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178281.6997743, abbf98e1-d609-49ab-8b7f-6b8d57f2718a => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:31:21 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] VM Started (Lifecycle Event)
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-8f0ece49-da6f-46ab-a4b3-8ed1e4c0b603 req-5f54044f-c8bc-4631-8f26-3ce0d88c6a9f service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8f0ece49-da6f-46ab-a4b3-8ed1e4c0b603 req-5f54044f-c8bc-4631-8f26-3ce0d88c6a9f service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8f0ece49-da6f-46ab-a4b3-8ed1e4c0b603 req-5f54044f-c8bc-4631-8f26-3ce0d88c6a9f service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8f0ece49-da6f-46ab-a4b3-8ed1e4c0b603 req-5f54044f-c8bc-4631-8f26-3ce0d88c6a9f service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-8f0ece49-da6f-46ab-a4b3-8ed1e4c0b603 req-5f54044f-c8bc-4631-8f26-3ce0d88c6a9f service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:31:21 user nova-compute[73208]: WARNING nova.compute.manager [req-8f0ece49-da6f-46ab-a4b3-8ed1e4c0b603 req-5f54044f-c8bc-4631-8f26-3ce0d88c6a9f service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state active and task_state None.
Aug 16 09:31:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:31:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:31:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:31:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:31:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8081MB free_disk=25.045196533203125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance af45d645-fd93-4e44-9700-018b121659c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance abbf98e1-d609-49ab-8b7f-6b8d57f2718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f5067d00-0cd2-40f2-875f-577760762123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:31:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:31:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:36 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:31:36 user nova-compute[73208]: INFO nova.compute.claims [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Claim successful on node user
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:31:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:31:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Creating image(s)
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "/opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "/opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG nova.policy [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18737770cdee43d6a782ebbbd311e8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12301729e76a42afa0c8923d3d428cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk 1073741824" returned: 0 in 0.056s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.171s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Successfully created port: 27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Cannot resize image /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'migration_context' on Instance uuid 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Ensure instance console log exists: /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:31:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Successfully updated port: 27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquired lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-bf2eac17-3977-4fe2-81a8-35aaf4642210 req-59bd4fed-0e93-4d5a-a7a4-337e95b2df06 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received event network-changed-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-bf2eac17-3977-4fe2-81a8-35aaf4642210 req-59bd4fed-0e93-4d5a-a7a4-337e95b2df06 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Refreshing instance network info cache due to event network-changed-27010a0b-da80-4d5a-94a3-8858163d055a. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bf2eac17-3977-4fe2-81a8-35aaf4642210 req-59bd4fed-0e93-4d5a-a7a4-337e95b2df06 service nova] Acquiring lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Updating instance_info_cache with network_info: [{"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Releasing lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Instance network_info: |[{"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bf2eac17-3977-4fe2-81a8-35aaf4642210 req-59bd4fed-0e93-4d5a-a7a4-337e95b2df06 service nova] Acquired lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-bf2eac17-3977-4fe2-81a8-35aaf4642210 req-59bd4fed-0e93-4d5a-a7a4-337e95b2df06 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Refreshing network info cache for port 27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Start _get_guest_xml network_info=[{"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:31:39 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:31:39 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:31:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1456937127',display_name='tempest-AttachVolumeNegativeTest-server-1456937127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1456937127',id=41,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn/crvrQLax0+5G5LX8U7TjmKlQLh+uTCgxbZrm41FBGePGenSnaMj5j69mPrT+/Aj6Ilr9vZsWSd9oszTwP1LeBlvBQ7XdTISNfztd791Lw/RQmORiWvPhss3/zsDrTw==',key_name='tempest-keypair-803189121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-7ot8mpgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:31:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=8a9c86f4-584f-4907-bd7f-ba28fcc686d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:9b,bridge_name='br-int',has_traffic_filtering=True,id=27010a0b-da80-4d5a-94a3-8858163d055a,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27010a0b-da') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:31:39 user nova-compute[73208]:   <uuid>8a9c86f4-584f-4907-bd7f-ba28fcc686d4</uuid>
Aug 16 09:31:39 user nova-compute[73208]:   <name>instance-00000029</name>
Aug 16 09:31:39 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:31:39 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:31:39 user nova-compute[73208]:   <metadata>
Aug 16 09:31:39 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:31:39 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:31:39 user nova-compute[73208]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1456937127</nova:name>
Aug 16 09:31:39 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:31:39</nova:creationTime>
Aug 16 09:31:39 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:31:39 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:31:39 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:31:39 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:31:39 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:31:39 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:31:39 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:31:39 user nova-compute[73208]:       <nova:owner>
Aug 16 09:31:39 user nova-compute[73208]:         <nova:user uuid="18737770cdee43d6a782ebbbd311e8fc">tempest-AttachVolumeNegativeTest-657236303-project-member</nova:user>
Aug 16 09:31:39 user nova-compute[73208]:         <nova:project uuid="12301729e76a42afa0c8923d3d428cac">tempest-AttachVolumeNegativeTest-657236303</nova:project>
Aug 16 09:31:39 user nova-compute[73208]:       </nova:owner>
Aug 16 09:31:39 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:31:39 user nova-compute[73208]:       <nova:ports>
Aug 16 09:31:39 user nova-compute[73208]:         <nova:port uuid="27010a0b-da80-4d5a-94a3-8858163d055a">
Aug 16 09:31:39 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 09:31:39 user nova-compute[73208]:         </nova:port>
Aug 16 09:31:39 user nova-compute[73208]:       </nova:ports>
Aug 16 09:31:39 user nova-compute[73208]:     </nova:instance>
Aug 16 09:31:39 user nova-compute[73208]:   </metadata>
Aug 16 09:31:39 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:31:39 user nova-compute[73208]:     <system>
Aug 16 09:31:39 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:31:39 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:31:39 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:31:39 user nova-compute[73208]:       <entry name="serial">8a9c86f4-584f-4907-bd7f-ba28fcc686d4</entry>
Aug 16 09:31:39 user nova-compute[73208]:       <entry name="uuid">8a9c86f4-584f-4907-bd7f-ba28fcc686d4</entry>
Aug 16 09:31:39 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:31:39 user nova-compute[73208]:     </system>
Aug 16 09:31:39 user nova-compute[73208]:   </sysinfo>
Aug 16 09:31:39 user nova-compute[73208]:   <os>
Aug 16 09:31:39 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:31:39 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:31:39 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:31:39 user nova-compute[73208]:   </os>
Aug 16 09:31:39 user nova-compute[73208]:   <features>
Aug 16 09:31:39 user nova-compute[73208]:     <acpi/>
Aug 16 09:31:39 user nova-compute[73208]:     <apic/>
Aug 16 09:31:39 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:31:39 user nova-compute[73208]:   </features>
Aug 16 09:31:39 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:31:39 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:31:39 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:31:39 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:31:39 user nova-compute[73208]:   </clock>
Aug 16 09:31:39 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:31:39 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:31:39 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:31:39 user nova-compute[73208]:   </cpu>
Aug 16 09:31:39 user nova-compute[73208]:   <devices>
Aug 16 09:31:39 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:31:39 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:31:39 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk"/>
Aug 16 09:31:39 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:31:39 user nova-compute[73208]:     </disk>
Aug 16 09:31:39 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:31:39 user nova-compute[73208]:       <mac address="fa:16:3e:12:75:9b"/>
Aug 16 09:31:39 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:31:39 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:31:39 user nova-compute[73208]:       <target dev="tap27010a0b-da"/>
Aug 16 09:31:39 user nova-compute[73208]:     </interface>
Aug 16 09:31:39 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:31:39 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/console.log" append="off"/>
Aug 16 09:31:39 user nova-compute[73208]:     </serial>
Aug 16 09:31:39 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:31:39 user nova-compute[73208]:     <video>
Aug 16 09:31:39 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:31:39 user nova-compute[73208]:     </video>
Aug 16 09:31:39 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:31:39 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:31:39 user nova-compute[73208]:     </rng>
Aug 16 09:31:39 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:31:39 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:31:39 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:31:39 user nova-compute[73208]:     </memballoon>
Aug 16 09:31:39 user nova-compute[73208]:   </devices>
Aug 16 09:31:39 user nova-compute[73208]: </domain>
Aug 16 09:31:39 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:31:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1456937127',display_name='tempest-AttachVolumeNegativeTest-server-1456937127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1456937127',id=41,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn/crvrQLax0+5G5LX8U7TjmKlQLh+uTCgxbZrm41FBGePGenSnaMj5j69mPrT+/Aj6Ilr9vZsWSd9oszTwP1LeBlvBQ7XdTISNfztd791Lw/RQmORiWvPhss3/zsDrTw==',key_name='tempest-keypair-803189121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-7ot8mpgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:31:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=8a9c86f4-584f-4907-bd7f-ba28fcc686d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:9b,bridge_name='br-int',has_traffic_filtering=True,id=27010a0b-da80-4d5a-94a3-8858163d055a,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27010a0b-da') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG os_vif [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:9b,bridge_name='br-int',has_traffic_filtering=True,id=27010a0b-da80-4d5a-94a3-8858163d055a,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27010a0b-da') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27010a0b-da, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27010a0b-da, col_values=(('external_ids', {'iface-id': '27010a0b-da80-4d5a-94a3-8858163d055a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:75:9b', 'vm-uuid': '8a9c86f4-584f-4907-bd7f-ba28fcc686d4'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:39 user nova-compute[73208]: INFO os_vif [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:9b,bridge_name='br-int',has_traffic_filtering=True,id=27010a0b-da80-4d5a-94a3-8858163d055a,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27010a0b-da')
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No VIF found with MAC fa:16:3e:12:75:9b, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:31:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-bf2eac17-3977-4fe2-81a8-35aaf4642210 req-59bd4fed-0e93-4d5a-a7a4-337e95b2df06 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Updated VIF entry in instance network info cache for port 27010a0b-da80-4d5a-94a3-8858163d055a. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-bf2eac17-3977-4fe2-81a8-35aaf4642210 req-59bd4fed-0e93-4d5a-a7a4-337e95b2df06 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Updating instance_info_cache with network_info: [{"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bf2eac17-3977-4fe2-81a8-35aaf4642210 req-59bd4fed-0e93-4d5a-a7a4-337e95b2df06 service nova] Releasing lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-f34b030b-14c2-44ce-a176-da618a1bb0b2 req-54dc624a-2ea3-4478-8269-fbc286923060 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received event network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:31:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f34b030b-14c2-44ce-a176-da618a1bb0b2 req-54dc624a-2ea3-4478-8269-fbc286923060 service nova] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f34b030b-14c2-44ce-a176-da618a1bb0b2 req-54dc624a-2ea3-4478-8269-fbc286923060 service nova] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f34b030b-14c2-44ce-a176-da618a1bb0b2 req-54dc624a-2ea3-4478-8269-fbc286923060 service nova] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-f34b030b-14c2-44ce-a176-da618a1bb0b2 req-54dc624a-2ea3-4478-8269-fbc286923060 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] No waiting events found dispatching network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:31:41 user nova-compute[73208]: WARNING nova.compute.manager [req-f34b030b-14c2-44ce-a176-da618a1bb0b2 req-54dc624a-2ea3-4478-8269-fbc286923060 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received unexpected event network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a for instance with vm_state building and task_state spawning.
Aug 16 09:31:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178303.0782018, 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:31:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] VM Resumed (Lifecycle Event)
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:31:43 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Instance spawned successfully.
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:31:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178303.082165, 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:31:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] VM Started (Lifecycle Event)
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:31:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:31:43 user nova-compute[73208]: INFO nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-332719dc-9840-408c-8ab3-193a4e171c8f req-2e1cd5e3-9932-4f67-9c2c-22653ff33eea service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received event network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-332719dc-9840-408c-8ab3-193a4e171c8f req-2e1cd5e3-9932-4f67-9c2c-22653ff33eea service nova] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-332719dc-9840-408c-8ab3-193a4e171c8f req-2e1cd5e3-9932-4f67-9c2c-22653ff33eea service nova] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-332719dc-9840-408c-8ab3-193a4e171c8f req-2e1cd5e3-9932-4f67-9c2c-22653ff33eea service nova] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-332719dc-9840-408c-8ab3-193a4e171c8f req-2e1cd5e3-9932-4f67-9c2c-22653ff33eea service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] No waiting events found dispatching network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:31:43 user nova-compute[73208]: WARNING nova.compute.manager [req-332719dc-9840-408c-8ab3-193a4e171c8f req-2e1cd5e3-9932-4f67-9c2c-22653ff33eea service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received unexpected event network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a for instance with vm_state building and task_state spawning.
Aug 16 09:31:43 user nova-compute[73208]: INFO nova.compute.manager [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Took 6.55 seconds to build instance.
Aug 16 09:31:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ac0d0c8f-4279-464e-9f50-30360f22962b tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.648s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:31:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:31:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:00 user nova-compute[73208]: INFO nova.compute.manager [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Unshelving
Aug 16 09:32:00 user nova-compute[73208]: INFO nova.virt.block_device [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Booting with volume ac69d2fd-e25a-4976-b618-65c6280a3589 at /dev/vda
Aug 16 09:32:00 user nova-compute[73208]: DEBUG os_brick.utils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1de57b-2d32-4086-9869-d32a71b00200]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[24921eb1-2a55-403a-b1ec-95bd4815f5db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5c7a30-c8af-417a-871c-941d3d450de8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[18744acd-b461-4d1d-9a1f-aabbb66da011]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:32:00 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:32:00 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80735cf-82a0-41d0-b3bc-e9f93908f3ad]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG os_brick.utils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:32:00 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating existing volume attachment record: 033b1368-a2e8-4fd4-a5d6-50f85c95b048 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:32:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:11 user nova-compute[73208]: INFO nova.compute.manager [None req-1f62925f-e1ad-4e11-9d9b-b3bf0d1c0bf5 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Unrescuing
Aug 16 09:32:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1f62925f-e1ad-4e11-9d9b-b3bf0d1c0bf5 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1f62925f-e1ad-4e11-9d9b-b3bf0d1c0bf5 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquired lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG nova.network.neutron [None req-1f62925f-e1ad-4e11-9d9b-b3bf0d1c0bf5 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lazy-loading 'pci_requests' on Instance uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lazy-loading 'numa_topology' on Instance uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:32:11 user nova-compute[73208]: INFO nova.compute.claims [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Claim successful on node user
Aug 16 09:32:11 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG nova.network.neutron [None req-1f62925f-e1ad-4e11-9d9b-b3bf0d1c0bf5 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-1f62925f-e1ad-4e11-9d9b-b3bf0d1c0bf5 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Releasing lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:11 user nova-compute[73208]: DEBUG nova.objects.instance [None req-1f62925f-e1ad-4e11-9d9b-b3bf0d1c0bf5 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'flavor' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:11 user nova-compute[73208]: INFO nova.network.neutron [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating port 33df2ec9-e747-45f1-b34a-03b6dd017cd7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-7e79c119-bc1d-4117-b632-22f93089df3d req-24693df9-dec0-4f61-82bd-56cc67ce9faa service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7e79c119-bc1d-4117-b632-22f93089df3d req-24693df9-dec0-4f61-82bd-56cc67ce9faa service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7e79c119-bc1d-4117-b632-22f93089df3d req-24693df9-dec0-4f61-82bd-56cc67ce9faa service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7e79c119-bc1d-4117-b632-22f93089df3d req-24693df9-dec0-4f61-82bd-56cc67ce9faa service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-7e79c119-bc1d-4117-b632-22f93089df3d req-24693df9-dec0-4f61-82bd-56cc67ce9faa service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:32:12 user nova-compute[73208]: WARNING nova.compute.manager [req-7e79c119-bc1d-4117-b632-22f93089df3d req-24693df9-dec0-4f61-82bd-56cc67ce9faa service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:32:12 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance destroyed successfully.
Aug 16 09:32:13 user nova-compute[73208]: DEBUG nova.compute.manager [req-cd3bad45-7ebd-4a7f-808b-8a22cad0e144 req-0b55f3a9-57f0-495a-afb2-c19bc9e8add3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-changed-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:13 user nova-compute[73208]: DEBUG nova.compute.manager [req-cd3bad45-7ebd-4a7f-808b-8a22cad0e144 req-0b55f3a9-57f0-495a-afb2-c19bc9e8add3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Refreshing instance network info cache due to event network-changed-8b20c094-a0f7-4c34-a98d-d2938c3ebb28. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:32:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cd3bad45-7ebd-4a7f-808b-8a22cad0e144 req-0b55f3a9-57f0-495a-afb2-c19bc9e8add3 service nova] Acquiring lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cd3bad45-7ebd-4a7f-808b-8a22cad0e144 req-0b55f3a9-57f0-495a-afb2-c19bc9e8add3 service nova] Acquired lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:13 user nova-compute[73208]: DEBUG nova.network.neutron [req-cd3bad45-7ebd-4a7f-808b-8a22cad0e144 req-0b55f3a9-57f0-495a-afb2-c19bc9e8add3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Refreshing network info cache for port 8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:32:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:13 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:13 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-df941b0e-12e0-4a67-a76f-2abae76a422c req-bc9f1b4a-db44-4956-ab2f-753f76262cbd service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-df941b0e-12e0-4a67-a76f-2abae76a422c req-bc9f1b4a-db44-4956-ab2f-753f76262cbd service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-df941b0e-12e0-4a67-a76f-2abae76a422c req-bc9f1b4a-db44-4956-ab2f-753f76262cbd service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-df941b0e-12e0-4a67-a76f-2abae76a422c req-bc9f1b4a-db44-4956-ab2f-753f76262cbd service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-df941b0e-12e0-4a67-a76f-2abae76a422c req-bc9f1b4a-db44-4956-ab2f-753f76262cbd service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:32:14 user nova-compute[73208]: WARNING nova.compute.manager [req-df941b0e-12e0-4a67-a76f-2abae76a422c req-bc9f1b4a-db44-4956-ab2f-753f76262cbd service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:32:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.network.neutron [req-cd3bad45-7ebd-4a7f-808b-8a22cad0e144 req-0b55f3a9-57f0-495a-afb2-c19bc9e8add3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updated VIF entry in instance network info cache for port 8b20c094-a0f7-4c34-a98d-d2938c3ebb28. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.network.neutron [req-cd3bad45-7ebd-4a7f-808b-8a22cad0e144 req-0b55f3a9-57f0-495a-afb2-c19bc9e8add3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cd3bad45-7ebd-4a7f-808b-8a22cad0e144 req-0b55f3a9-57f0-495a-afb2-c19bc9e8add3 service nova] Releasing lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:32:14 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Creating image(s)
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Ensure instance console log exists: /opt/stack/data/nova/instances/aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Start _get_guest_xml network_info=[{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '033b1368-a2e8-4fd4-a5d6-50f85c95b048', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWDtyxEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac69d2fd-e25a-4976-b618-65c6280a3589', 'serial': 'ac69d2fd-e25a-4976-b618-65c6280a3589'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:32:14 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:32:14 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lazy-loading 'vcpu_model' on Instance uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWDtyxEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:32:14 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:32:14 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:32:14 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f13e67b-b2d8-4884-a346-25babf43b74d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:32:14 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c8591-25fd-4850-a039-05bfb6cab762]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589] added
Aug 16 09:32:14 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d61878-2f2b-4945-bf27-50faefac0d81]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c026e040-1b05-43a2-91af-5ad8bf73a7b9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWDtyxEa {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWDtyxEa" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[44377858-6cb1-4f1d-8a46-d162ec139f4f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWDtyxEa'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7ebaed-b6b7-4f3a-a2eb-081c225c998d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7ee9b9-ea7a-4bbd-9c4f-0abe310a6fc3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:14 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:14 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:32:14 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:14 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:14 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:32:14 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:32:14 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2d93cb-7f97-4626-84d7-27fa47ba73ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260]
Aug 16 09:32:15 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260] successful.
Aug 16 09:32:15 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3491c3f-dbfa-4be0-b4b2-c380ed9e516e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c2824-5ed9-46a0-8c6c-c2586942342b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:15 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:15 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:32:15 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:32:15 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:15 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:15 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:32:15 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:32:15 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[208b14ce-c968-482c-9aee-21e93fb0c43c]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWDtyxEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-changed-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Refreshing instance network info cache due to event network-changed-8b20c094-a0f7-4c34-a98d-d2938c3ebb28. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] Acquiring lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] Acquired lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:15 user nova-compute[73208]: DEBUG nova.network.neutron [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Refreshing network info cache for port 8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23637373935383230', 'path': '/dev/sde'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373935383230', 'path': '/dev/sde'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-520207354',display_name='tempest-TestShelveInstance-server-520207354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-520207354',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1927113377',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='21041c92f02043e0baa0f6abeadcd78e',ramdisk_id='',reservation_id='r-g3kxydmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1402301442',owner_user_name='tempest-TestShelveInstance-1402301442-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:32:00Z,user_data=None,user_id='f9014d0cab7e416fa4e030653fd4b01d',uuid=aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converting VIF {"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lazy-loading 'pci_devices' on Instance uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:32:16 user nova-compute[73208]:   <uuid>aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727</uuid>
Aug 16 09:32:16 user nova-compute[73208]:   <name>instance-00000027</name>
Aug 16 09:32:16 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:32:16 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:32:16 user nova-compute[73208]:   <metadata>
Aug 16 09:32:16 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:32:16 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:32:16 user nova-compute[73208]:       <nova:name>tempest-TestShelveInstance-server-520207354</nova:name>
Aug 16 09:32:16 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:32:14</nova:creationTime>
Aug 16 09:32:16 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:32:16 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:32:16 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:32:16 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:32:16 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:32:16 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:32:16 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:32:16 user nova-compute[73208]:       <nova:owner>
Aug 16 09:32:16 user nova-compute[73208]:         <nova:user uuid="f9014d0cab7e416fa4e030653fd4b01d">tempest-TestShelveInstance-1402301442-project-member</nova:user>
Aug 16 09:32:16 user nova-compute[73208]:         <nova:project uuid="21041c92f02043e0baa0f6abeadcd78e">tempest-TestShelveInstance-1402301442</nova:project>
Aug 16 09:32:16 user nova-compute[73208]:       </nova:owner>
Aug 16 09:32:16 user nova-compute[73208]:       <nova:ports>
Aug 16 09:32:16 user nova-compute[73208]:         <nova:port uuid="33df2ec9-e747-45f1-b34a-03b6dd017cd7">
Aug 16 09:32:16 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:32:16 user nova-compute[73208]:         </nova:port>
Aug 16 09:32:16 user nova-compute[73208]:       </nova:ports>
Aug 16 09:32:16 user nova-compute[73208]:     </nova:instance>
Aug 16 09:32:16 user nova-compute[73208]:   </metadata>
Aug 16 09:32:16 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:32:16 user nova-compute[73208]:     <system>
Aug 16 09:32:16 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:32:16 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:32:16 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:32:16 user nova-compute[73208]:       <entry name="serial">aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727</entry>
Aug 16 09:32:16 user nova-compute[73208]:       <entry name="uuid">aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727</entry>
Aug 16 09:32:16 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:32:16 user nova-compute[73208]:     </system>
Aug 16 09:32:16 user nova-compute[73208]:   </sysinfo>
Aug 16 09:32:16 user nova-compute[73208]:   <os>
Aug 16 09:32:16 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:32:16 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:32:16 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:32:16 user nova-compute[73208]:   </os>
Aug 16 09:32:16 user nova-compute[73208]:   <features>
Aug 16 09:32:16 user nova-compute[73208]:     <acpi/>
Aug 16 09:32:16 user nova-compute[73208]:     <apic/>
Aug 16 09:32:16 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:32:16 user nova-compute[73208]:   </features>
Aug 16 09:32:16 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:32:16 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:32:16 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:32:16 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:32:16 user nova-compute[73208]:   </clock>
Aug 16 09:32:16 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:32:16 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:32:16 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:32:16 user nova-compute[73208]:   </cpu>
Aug 16 09:32:16 user nova-compute[73208]:   <devices>
Aug 16 09:32:16 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:32:16 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:32:16 user nova-compute[73208]:       <source dev="/dev/sde"/>
Aug 16 09:32:16 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:32:16 user nova-compute[73208]:       <serial>ac69d2fd-e25a-4976-b618-65c6280a3589</serial>
Aug 16 09:32:16 user nova-compute[73208]:     </disk>
Aug 16 09:32:16 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:32:16 user nova-compute[73208]:       <mac address="fa:16:3e:54:bb:79"/>
Aug 16 09:32:16 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:32:16 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:32:16 user nova-compute[73208]:       <target dev="tap33df2ec9-e7"/>
Aug 16 09:32:16 user nova-compute[73208]:     </interface>
Aug 16 09:32:16 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:32:16 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727/console.log" append="off"/>
Aug 16 09:32:16 user nova-compute[73208]:     </serial>
Aug 16 09:32:16 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:32:16 user nova-compute[73208]:     <video>
Aug 16 09:32:16 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:32:16 user nova-compute[73208]:     </video>
Aug 16 09:32:16 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:32:16 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:32:16 user nova-compute[73208]:     </rng>
Aug 16 09:32:16 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:32:16 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:32:16 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:32:16 user nova-compute[73208]:     </memballoon>
Aug 16 09:32:16 user nova-compute[73208]:   </devices>
Aug 16 09:32:16 user nova-compute[73208]: </domain>
Aug 16 09:32:16 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-520207354',display_name='tempest-TestShelveInstance-server-520207354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-520207354',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1927113377',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='21041c92f02043e0baa0f6abeadcd78e',ramdisk_id='',reservation_id='r-g3kxydmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1402301442',owner_user_name='tempest-TestShelveInstance-1402301442-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:32:00Z,user_data=None,user_id='f9014d0cab7e416fa4e030653fd4b01d',uuid=aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converting VIF {"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG os_vif [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33df2ec9-e7, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33df2ec9-e7, col_values=(('external_ids', {'iface-id': '33df2ec9-e747-45f1-b34a-03b6dd017cd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:bb:79', 'vm-uuid': 'aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:16 user nova-compute[73208]: INFO os_vif [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7')
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] No VIF found with MAC fa:16:3e:54:bb:79, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:32:16 user nova-compute[73208]: WARNING nova.compute.manager [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:32:16 user nova-compute[73208]: WARNING nova.compute.manager [req-e2068165-28c9-4f9f-bf44-4b0f9530032e req-05d19cce-418b-4d74-a207-4875db17fe0d service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updated VIF entry in instance network info cache for port 8b20c094-a0f7-4c34-a98d-d2938c3ebb28. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [{"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] Releasing lock "refresh_cache-af45d645-fd93-4e44-9700-018b121659c1" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing instance network info cache due to event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:16 user nova-compute[73208]: DEBUG nova.network.neutron [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-1f62925f-e1ad-4e11-9d9b-b3bf0d1c0bf5 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for af45d645-fd93-4e44-9700-018b121659c1 due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178337.0017025, af45d645-fd93-4e44-9700-018b121659c1 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:32:17 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] VM Resumed (Lifecycle Event)
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178337.007899, af45d645-fd93-4e44-9700-018b121659c1 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:32:17 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] VM Started (Lifecycle Event)
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.network.neutron [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updated VIF entry in instance network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.network.neutron [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9a38a9e6-fe74-41b8-ad13-d05fccb803ce req-de563d6c-62bc-4f21-8409-81c5fe694399 service nova] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-41955319-22f7-4bf8-814f-1c0e88dd112a req-663e962d-c080-4f5d-a998-699a05486b86 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-41955319-22f7-4bf8-814f-1c0e88dd112a req-663e962d-c080-4f5d-a998-699a05486b86 service nova] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-41955319-22f7-4bf8-814f-1c0e88dd112a req-663e962d-c080-4f5d-a998-699a05486b86 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-41955319-22f7-4bf8-814f-1c0e88dd112a req-663e962d-c080-4f5d-a998-699a05486b86 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-41955319-22f7-4bf8-814f-1c0e88dd112a req-663e962d-c080-4f5d-a998-699a05486b86 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] No waiting events found dispatching network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:32:17 user nova-compute[73208]: WARNING nova.compute.manager [req-41955319-22f7-4bf8-814f-1c0e88dd112a req-663e962d-c080-4f5d-a998-699a05486b86 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received unexpected event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 09:32:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:19 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178339.9900138, aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:32:19 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] VM Resumed (Lifecycle Event)
Aug 16 09:32:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:32:19 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:32:20 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance spawned successfully.
Aug 16 09:32:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-1909685b-b67d-4766-bfdd-71f93a99f33f req-d0f9bb7e-08e1-42c2-ad2c-bc87b8c281a5 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1909685b-b67d-4766-bfdd-71f93a99f33f req-d0f9bb7e-08e1-42c2-ad2c-bc87b8c281a5 service nova] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1909685b-b67d-4766-bfdd-71f93a99f33f req-d0f9bb7e-08e1-42c2-ad2c-bc87b8c281a5 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1909685b-b67d-4766-bfdd-71f93a99f33f req-d0f9bb7e-08e1-42c2-ad2c-bc87b8c281a5 service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-1909685b-b67d-4766-bfdd-71f93a99f33f req-d0f9bb7e-08e1-42c2-ad2c-bc87b8c281a5 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] No waiting events found dispatching network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:32:20 user nova-compute[73208]: WARNING nova.compute.manager [req-1909685b-b67d-4766-bfdd-71f93a99f33f req-d0f9bb7e-08e1-42c2-ad2c-bc87b8c281a5 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received unexpected event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 09:32:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:32:20 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178339.9933984, aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:32:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] VM Started (Lifecycle Event)
Aug 16 09:32:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:32:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b175fa4c-5823-4ada-b47c-3473f72f05c1 tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.964s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:30 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:32:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:32:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:31 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:32:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:32:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=25.01314926147461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance af45d645-fd93-4e44-9700-018b121659c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance abbf98e1-d609-49ab-8b7f-6b8d57f2718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f5067d00-0cd2-40f2-875f-577760762123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:32:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:32:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:34 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:32:34 user nova-compute[73208]: INFO nova.compute.claims [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Claim successful on node user
Aug 16 09:32:34 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:32:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.policy [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c8d33aff1c142f0b93dbfe203ca040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0176f0acf145c799a0ec1fbdc2fef7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:32:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Creating image(s)
Aug 16 09:32:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "/opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "/opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "/opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "a8874da7757b25abc7f6f39a0efb4a19c3324b3f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "a8874da7757b25abc7f6f39a0efb4a19c3324b3f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:35 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f.part --force-share --output=json" returned: 0 in 0.209s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG nova.virt.images [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] 6b3f0c68-f252-4874-8dba-0fdc99519093 was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f.part /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Successfully created port: 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-6d4101f3-87b6-4731-9815-d8e24c596378 req-9f3271a3-2d7a-42e0-a2f3-ec5f6f7f660d service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received event network-changed-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-6d4101f3-87b6-4731-9815-d8e24c596378 req-9f3271a3-2d7a-42e0-a2f3-ec5f6f7f660d service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Refreshing instance network info cache due to event network-changed-3924f9e2-9ac8-4f12-97b4-49527111727e. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6d4101f3-87b6-4731-9815-d8e24c596378 req-9f3271a3-2d7a-42e0-a2f3-ec5f6f7f660d service nova] Acquiring lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6d4101f3-87b6-4731-9815-d8e24c596378 req-9f3271a3-2d7a-42e0-a2f3-ec5f6f7f660d service nova] Acquired lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG nova.network.neutron [req-6d4101f3-87b6-4731-9815-d8e24c596378 req-9f3271a3-2d7a-42e0-a2f3-ec5f6f7f660d service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Refreshing network info cache for port 3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f.part /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f.converted" returned: 0 in 0.400s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f.converted --force-share --output=json" returned: 0 in 0.240s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "a8874da7757b25abc7f6f39a0efb4a19c3324b3f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.406s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f --force-share --output=json" returned: 0 in 0.205s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "a8874da7757b25abc7f6f39a0efb4a19c3324b3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "a8874da7757b25abc7f6f39a0efb4a19c3324b3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Successfully updated port: 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-a994aa32-7fcd-4b16-9547-150b5044b61f req-92adb960-8f48-49fa-b33b-a0b6ca493c21 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-a994aa32-7fcd-4b16-9547-150b5044b61f req-92adb960-8f48-49fa-b33b-a0b6ca493c21 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing instance network info cache due to event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a994aa32-7fcd-4b16-9547-150b5044b61f req-92adb960-8f48-49fa-b33b-a0b6ca493c21 service nova] Acquiring lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a994aa32-7fcd-4b16-9547-150b5044b61f req-92adb960-8f48-49fa-b33b-a0b6ca493c21 service nova] Acquired lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [req-a994aa32-7fcd-4b16-9547-150b5044b61f req-92adb960-8f48-49fa-b33b-a0b6ca493c21 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [req-6d4101f3-87b6-4731-9815-d8e24c596378 req-9f3271a3-2d7a-42e0-a2f3-ec5f6f7f660d service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updated VIF entry in instance network info cache for port 3924f9e2-9ac8-4f12-97b4-49527111727e. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [req-6d4101f3-87b6-4731-9815-d8e24c596378 req-9f3271a3-2d7a-42e0-a2f3-ec5f6f7f660d service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating instance_info_cache with network_info: [{"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6d4101f3-87b6-4731-9815-d8e24c596378 req-9f3271a3-2d7a-42e0-a2f3-ec5f6f7f660d service nova] Releasing lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [req-a994aa32-7fcd-4b16-9547-150b5044b61f req-92adb960-8f48-49fa-b33b-a0b6ca493c21 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f,backing_fmt=raw /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f,backing_fmt=raw /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk 1073741824" returned: 0 in 0.063s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "a8874da7757b25abc7f6f39a0efb4a19c3324b3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [req-a994aa32-7fcd-4b16-9547-150b5044b61f req-92adb960-8f48-49fa-b33b-a0b6ca493c21 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a994aa32-7fcd-4b16-9547-150b5044b61f req-92adb960-8f48-49fa-b33b-a0b6ca493c21 service nova] Releasing lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquired lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Cannot resize image /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'migration_context' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Ensure instance console log exists: /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Releasing lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance network_info: |[{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Start _get_guest_xml network_info=[{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:32:32Z,direct_url=<?>,disk_format='qcow2',id=6b3f0c68-f252-4874-8dba-0fdc99519093,min_disk=0,min_ram=0,name='tempest-scenario-img--1784267209',owner='3b0176f0acf145c799a0ec1fbdc2fef7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:32:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '6b3f0c68-f252-4874-8dba-0fdc99519093'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:32:37 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:32:37 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:32:32Z,direct_url=<?>,disk_format='qcow2',id=6b3f0c68-f252-4874-8dba-0fdc99519093,min_disk=0,min_ram=0,name='tempest-scenario-img--1784267209',owner='3b0176f0acf145c799a0ec1fbdc2fef7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:32:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-370990005',display_name='tempest-TestMinimumBasicScenario-server-370990005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-370990005',id=42,image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/bvUoe0c9XW9H9zrOQ9LVKbFwIs3jKg/hacX9jbr6f4jH59qxjDPnjAV8HrD3HO6MnF+Yu8Ef+hYeYULT8BU79HFKR08unvstxJ2VDdAFdxipNeZJsLP0XTmeSHKRUrA==',key_name='tempest-TestMinimumBasicScenario-1073759525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-mfy04f1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:32:35Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=42f666e9-8880-42ac-9645-bf25038ca521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'pci_devices' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:32:37 user nova-compute[73208]:   <uuid>42f666e9-8880-42ac-9645-bf25038ca521</uuid>
Aug 16 09:32:37 user nova-compute[73208]:   <name>instance-0000002a</name>
Aug 16 09:32:37 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:32:37 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:32:37 user nova-compute[73208]:   <metadata>
Aug 16 09:32:37 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:32:37 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:32:37 user nova-compute[73208]:       <nova:name>tempest-TestMinimumBasicScenario-server-370990005</nova:name>
Aug 16 09:32:37 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:32:37</nova:creationTime>
Aug 16 09:32:37 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:32:37 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:32:37 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:32:37 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:32:37 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:32:37 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:32:37 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:32:37 user nova-compute[73208]:       <nova:owner>
Aug 16 09:32:37 user nova-compute[73208]:         <nova:user uuid="8c8d33aff1c142f0b93dbfe203ca040f">tempest-TestMinimumBasicScenario-1791382392-project-member</nova:user>
Aug 16 09:32:37 user nova-compute[73208]:         <nova:project uuid="3b0176f0acf145c799a0ec1fbdc2fef7">tempest-TestMinimumBasicScenario-1791382392</nova:project>
Aug 16 09:32:37 user nova-compute[73208]:       </nova:owner>
Aug 16 09:32:37 user nova-compute[73208]:       <nova:root type="image" uuid="6b3f0c68-f252-4874-8dba-0fdc99519093"/>
Aug 16 09:32:37 user nova-compute[73208]:       <nova:ports>
Aug 16 09:32:37 user nova-compute[73208]:         <nova:port uuid="4ed116d6-1cd7-4da5-b739-9c9f26a0b80b">
Aug 16 09:32:37 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:32:37 user nova-compute[73208]:         </nova:port>
Aug 16 09:32:37 user nova-compute[73208]:       </nova:ports>
Aug 16 09:32:37 user nova-compute[73208]:     </nova:instance>
Aug 16 09:32:37 user nova-compute[73208]:   </metadata>
Aug 16 09:32:37 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:32:37 user nova-compute[73208]:     <system>
Aug 16 09:32:37 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:32:37 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:32:37 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:32:37 user nova-compute[73208]:       <entry name="serial">42f666e9-8880-42ac-9645-bf25038ca521</entry>
Aug 16 09:32:37 user nova-compute[73208]:       <entry name="uuid">42f666e9-8880-42ac-9645-bf25038ca521</entry>
Aug 16 09:32:37 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:32:37 user nova-compute[73208]:     </system>
Aug 16 09:32:37 user nova-compute[73208]:   </sysinfo>
Aug 16 09:32:37 user nova-compute[73208]:   <os>
Aug 16 09:32:37 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:32:37 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:32:37 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:32:37 user nova-compute[73208]:   </os>
Aug 16 09:32:37 user nova-compute[73208]:   <features>
Aug 16 09:32:37 user nova-compute[73208]:     <acpi/>
Aug 16 09:32:37 user nova-compute[73208]:     <apic/>
Aug 16 09:32:37 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:32:37 user nova-compute[73208]:   </features>
Aug 16 09:32:37 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:32:37 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:32:37 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:32:37 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:32:37 user nova-compute[73208]:   </clock>
Aug 16 09:32:37 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:32:37 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:32:37 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:32:37 user nova-compute[73208]:   </cpu>
Aug 16 09:32:37 user nova-compute[73208]:   <devices>
Aug 16 09:32:37 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:32:37 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:32:37 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk"/>
Aug 16 09:32:37 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:32:37 user nova-compute[73208]:     </disk>
Aug 16 09:32:37 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:32:37 user nova-compute[73208]:       <mac address="fa:16:3e:fc:19:56"/>
Aug 16 09:32:37 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:32:37 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:32:37 user nova-compute[73208]:       <target dev="tap4ed116d6-1c"/>
Aug 16 09:32:37 user nova-compute[73208]:     </interface>
Aug 16 09:32:37 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:32:37 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/console.log" append="off"/>
Aug 16 09:32:37 user nova-compute[73208]:     </serial>
Aug 16 09:32:37 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:32:37 user nova-compute[73208]:     <video>
Aug 16 09:32:37 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:32:37 user nova-compute[73208]:     </video>
Aug 16 09:32:37 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:32:37 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:32:37 user nova-compute[73208]:     </rng>
Aug 16 09:32:37 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:32:37 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:32:37 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:32:37 user nova-compute[73208]:     </memballoon>
Aug 16 09:32:37 user nova-compute[73208]:   </devices>
Aug 16 09:32:37 user nova-compute[73208]: </domain>
Aug 16 09:32:37 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-370990005',display_name='tempest-TestMinimumBasicScenario-server-370990005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-370990005',id=42,image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/bvUoe0c9XW9H9zrOQ9LVKbFwIs3jKg/hacX9jbr6f4jH59qxjDPnjAV8HrD3HO6MnF+Yu8Ef+hYeYULT8BU79HFKR08unvstxJ2VDdAFdxipNeZJsLP0XTmeSHKRUrA==',key_name='tempest-TestMinimumBasicScenario-1073759525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-mfy04f1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:32:35Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=42f666e9-8880-42ac-9645-bf25038ca521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG os_vif [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ed116d6-1c, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ed116d6-1c, col_values=(('external_ids', {'iface-id': '4ed116d6-1cd7-4da5-b739-9c9f26a0b80b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:19:56', 'vm-uuid': '42f666e9-8880-42ac-9645-bf25038ca521'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:32:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:37 user nova-compute[73208]: INFO os_vif [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c')
Aug 16 09:32:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:32:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No VIF found with MAC fa:16:3e:fc:19:56, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:32:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-df72ef9c-a0de-42da-bcd1-20e3a7e8446b req-c2ad8f37-a9b9-472e-82c4-182de066a2ef service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-df72ef9c-a0de-42da-bcd1-20e3a7e8446b req-c2ad8f37-a9b9-472e-82c4-182de066a2ef service nova] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-df72ef9c-a0de-42da-bcd1-20e3a7e8446b req-c2ad8f37-a9b9-472e-82c4-182de066a2ef service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-df72ef9c-a0de-42da-bcd1-20e3a7e8446b req-c2ad8f37-a9b9-472e-82c4-182de066a2ef service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-df72ef9c-a0de-42da-bcd1-20e3a7e8446b req-c2ad8f37-a9b9-472e-82c4-182de066a2ef service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] No waiting events found dispatching network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:32:39 user nova-compute[73208]: WARNING nova.compute.manager [req-df72ef9c-a0de-42da-bcd1-20e3a7e8446b req-c2ad8f37-a9b9-472e-82c4-182de066a2ef service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received unexpected event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b for instance with vm_state building and task_state spawning.
Aug 16 09:32:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:32:39 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:32:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:40 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updating instance_info_cache with network_info: [{"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:32:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-abbf98e1-d609-49ab-8b7f-6b8d57f2718a" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:32:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-2c51ceaa-9856-4af0-9cd8-0d8491adbc5f req-19a229dd-f00c-4804-a695-da43eec125aa service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2c51ceaa-9856-4af0-9cd8-0d8491adbc5f req-19a229dd-f00c-4804-a695-da43eec125aa service nova] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2c51ceaa-9856-4af0-9cd8-0d8491adbc5f req-19a229dd-f00c-4804-a695-da43eec125aa service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2c51ceaa-9856-4af0-9cd8-0d8491adbc5f req-19a229dd-f00c-4804-a695-da43eec125aa service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-2c51ceaa-9856-4af0-9cd8-0d8491adbc5f req-19a229dd-f00c-4804-a695-da43eec125aa service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] No waiting events found dispatching network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:32:41 user nova-compute[73208]: WARNING nova.compute.manager [req-2c51ceaa-9856-4af0-9cd8-0d8491adbc5f req-19a229dd-f00c-4804-a695-da43eec125aa service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received unexpected event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b for instance with vm_state building and task_state spawning.
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178361.674148, 42f666e9-8880-42ac-9645-bf25038ca521 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:32:41 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] VM Resumed (Lifecycle Event)
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:32:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance spawned successfully.
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:32:41 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178361.675402, 42f666e9-8880-42ac-9645-bf25038ca521 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:32:41 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] VM Started (Lifecycle Event)
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:32:41 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:32:41 user nova-compute[73208]: INFO nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 16 09:32:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:32:41 user nova-compute[73208]: INFO nova.compute.manager [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Took 7.21 seconds to build instance.
Aug 16 09:32:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c6bb5088-2a02-4644-ade7-8c9ffe5c18ac tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.311s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG nova.objects.instance [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:42 user nova-compute[73208]: INFO nova.compute.manager [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attaching volume 32ed49e9-8db1-440c-87e7-d37cc25328dd to /dev/vdb
Aug 16 09:32:42 user nova-compute[73208]: DEBUG os_brick.utils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbe8616-9ea6-40fe-8427-c3cfd05765e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ad9daf-ef6c-4c89-9614-c91736b17084]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4aebe6-d534-41eb-ab1c-cbaadd248ccb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f9482c-ad73-41a0-b162-84f7f5a854e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:32:42 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:32:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77c9fe6-d7c0-4ba1-adbd-020d9014f792]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG os_brick.utils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating existing volume attachment record: 05593bc7-0dfd-4a1b-9008-f99489801879 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:32:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:45 user nova-compute[73208]: INFO nova.compute.manager [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Detaching volume e8d169ec-490b-4b7e-a37a-94ecbdf77410
Aug 16 09:32:45 user nova-compute[73208]: INFO nova.virt.block_device [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Attempting to driver detach volume e8d169ec-490b-4b7e-a37a-94ecbdf77410 from mountpoint /dev/vdb
Aug 16 09:32:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Attempting to detach device vdb from instance af45d645-fd93-4e44-9700-018b121659c1 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:32:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:32:45 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:32:45 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:32:45 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:32:45 user nova-compute[73208]:   <serial>e8d169ec-490b-4b7e-a37a-94ecbdf77410</serial>
Aug 16 09:32:45 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:32:45 user nova-compute[73208]: </disk>
Aug 16 09:32:45 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:32:45 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Successfully detached device vdb from instance af45d645-fd93-4e44-9700-018b121659c1 from the persistent domain config.
Aug 16 09:32:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af45d645-fd93-4e44-9700-018b121659c1 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:32:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:32:45 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:32:45 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:32:45 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:32:45 user nova-compute[73208]:   <serial>e8d169ec-490b-4b7e-a37a-94ecbdf77410</serial>
Aug 16 09:32:45 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:32:45 user nova-compute[73208]: </disk>
Aug 16 09:32:45 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178366.2802782, af45d645-fd93-4e44-9700-018b121659c1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:32:46 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Successfully detached device vdb from instance af45d645-fd93-4e44-9700-018b121659c1 from the live domain config.
Aug 16 09:32:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'InZSlpfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:32:46 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b752633f-4c82-47cd-ae69-e5043dc5a8fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4225ab2-f7ff-4314-b804-8d2836f10aa4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:46 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:46 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:32:46 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:32:46 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:46 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:46 user nova-compute[73208]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 (non-flash)
Aug 16 09:32:46 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:32:46 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d074dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7880ad2-a13a-41d6-8d40-01586badb3a0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a994b3-e94d-4fff-b6ec-dda8facfe07f]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[907058ca-13d8-44c1-8dfe-229873743f13]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27decc0-5fdb-4bf1-af30-1f964cebc3f7]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b3ed14-e116-4630-aa10-0c554bf25b85]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f396a764-625a-4d54-a3f5-f42ced6a44b6]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410, portal: 172.16.0.220,3260]
Aug 16 09:32:46 user nova-compute[73208]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410, portal: 172.16.0.220,3260] successful.
Aug 16 09:32:46 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d169ec-490b-4b7e-a37a-94ecbdf77410 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b69011-7dff-4a13-bb72-13951da32b28]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] <== disconnect_volume: return (292ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:32:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:32:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:49 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:32:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELcCnHAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:32:53 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:32:53 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:32:53 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca0dc1f-df4b-4c6d-b324-a703443e530a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:32:53 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d59eaa-29ba-47d1-854f-90ba94c9fcdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd] added
Aug 16 09:32:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279512d-7601-4d26-9b4b-1a152c28bb37]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ffd2fe-821c-4778-9fdb-7ef2eb1246e5]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELcCnHAW {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELcCnHAW" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8df74eb-4077-4876-b312-7ddccfb3950e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELcCnHAW'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3e79a5-1eda-4dca-85f9-2c779f557991]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9208c47d-4e72-4a3e-b9b4-74ecb2bf2b46]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'flavor' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[94713da9-59e9-4031-8e2e-8aa9c8b44d88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd, portal: 172.16.0.220,3260]
Aug 16 09:32:53 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd, portal: 172.16.0.220,3260] successful.
Aug 16 09:32:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c15bae2-64b0-43d1-aea1-64538b01f95f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8d5f8c3a-a5d7-4f99-bd23-a1c71f1d7e7b tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.887s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f936b-0250-47b6-ac97-f4fa3bd59083]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)
Aug 16 09:32:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:32:53 user nova-compute[73208]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)
Aug 16 09:32:53 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[781ab440-915f-4278-958e-418f2277f567]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:32:53 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELcCnHAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:32:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:32:54 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23036643866636265', 'path': '/dev/sdd'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:32:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036643866636265', 'path': '/dev/sdd'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:32:54 user nova-compute[73208]: DEBUG nova.objects.instance [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:32:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:32:54 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:32:54 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:32:54 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:32:54 user nova-compute[73208]:   <serial>32ed49e9-8db1-440c-87e7-d37cc25328dd</serial>
Aug 16 09:32:54 user nova-compute[73208]: </disk>
Aug 16 09:32:54 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:32:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:32:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:32:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No VIF found with MAC fa:16:3e:0e:b5:ea, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:32:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-87bf0bef-6c49-46be-a3a7-8296e54825ed tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.707s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:32:58 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_power_states {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid e23ec51a-a5cb-451b-91aa-f2b241d2b0cd {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 0b6a305b-662e-4498-ac23-99ccfe1fca4f {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "6b259ec1-e74b-4255-aedf-685818f23c76" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "af45d645-fd93-4e44-9700-018b121659c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "42f666e9-8880-42ac-9645-bf25038ca521" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "af45d645-fd93-4e44-9700-018b121659c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "6b259ec1-e74b-4255-aedf-685818f23c76" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "42f666e9-8880-42ac-9645-bf25038ca521" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:32:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:07 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:33:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:33:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:08 user nova-compute[73208]: INFO nova.compute.manager [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Terminating instance
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-9d34e585-10db-4503-abbe-e3b30f8e96d2 req-8253a2fa-fcb7-4bce-94c9-1f7e8758bc3b service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9d34e585-10db-4503-abbe-e3b30f8e96d2 req-8253a2fa-fcb7-4bce-94c9-1f7e8758bc3b service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9d34e585-10db-4503-abbe-e3b30f8e96d2 req-8253a2fa-fcb7-4bce-94c9-1f7e8758bc3b service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9d34e585-10db-4503-abbe-e3b30f8e96d2 req-8253a2fa-fcb7-4bce-94c9-1f7e8758bc3b service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-9d34e585-10db-4503-abbe-e3b30f8e96d2 req-8253a2fa-fcb7-4bce-94c9-1f7e8758bc3b service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-9d34e585-10db-4503-abbe-e3b30f8e96d2 req-8253a2fa-fcb7-4bce-94c9-1f7e8758bc3b service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-unplugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:33:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Instance destroyed successfully.
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.objects.instance [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'resources' on Instance uuid abbf98e1-d609-49ab-8b7f-6b8d57f2718a {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-297253768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-297253768',id=37,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:29:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-04qko1jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:31:22Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=abbf98e1-d609-49ab-8b7f-6b8d57f2718a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "address": "fa:16:3e:98:48:f3", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2285ef4-64", "ovs_interfaceid": "c2285ef4-64f2-42cf-8995-04bc6ce4258c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=c2285ef4-64f2-42cf-8995-04bc6ce4258c,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2285ef4-64') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG os_vif [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=c2285ef4-64f2-42cf-8995-04bc6ce4258c,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2285ef4-64') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2285ef4-64, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:33:08 user nova-compute[73208]: INFO os_vif [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=c2285ef4-64f2-42cf-8995-04bc6ce4258c,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2285ef4-64')
Aug 16 09:33:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLUZldBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:33:08 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:33:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:33:08 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f2c399-688e-44cd-8e96-87146345e87a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d479f44-c846-4b4c-8398-cdcf82d44c92]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:09 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:33:09 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:09 user nova-compute[73208]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)
Aug 16 09:33:09 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:09 user nova-compute[73208]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 (non-flash)
Aug 16 09:33:09 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:09 user nova-compute[73208]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)
Aug 16 09:33:09 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f00f3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[035aac4f-9776-40fe-829f-3065c6ef9c88]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[283215bb-6eac-41c1-aae2-e6510915e230]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9cd6e4-3d70-4f1f-ab08-584cd9f9396a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde67d92-5eff-416a-9a37-ec2464b059e1]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4a683c87-58a7ecf5ed3008a5', '/dev/disk/by-id/scsi-23538613765636635', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a683c87') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[acef5cae-bfdf-4975-ad65-b4b6e9dbe793]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[211428ea-2a9c-42cd-85cd-8a5cc780b9ec]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3422db-c6c7-4eec-8b46-c24c019e479f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4, portal: 172.16.0.220,3260]
Aug 16 09:33:09 user nova-compute[73208]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4, portal: 172.16.0.220,3260] successful.
Aug 16 09:33:09 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36ffde6-8ea6-4113-b957-24b45608e9c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bca0aa0-0910-4123-8cba-f231507bd44b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] <== disconnect_volume: return (330ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:33:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Deleting instance files /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a_del
Aug 16 09:33:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Deletion of /opt/stack/data/nova/instances/abbf98e1-d609-49ab-8b7f-6b8d57f2718a_del complete
Aug 16 09:33:09 user nova-compute[73208]: INFO nova.compute.manager [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 16 09:33:09 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:33:09 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:33:09 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Took 0.48 seconds to deallocate network for instance.
Aug 16 09:33:10 user nova-compute[73208]: INFO nova.compute.manager [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 09:33:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-44ea6528-60b4-4cc5-903c-36628c2b09f3 req-ecf79479-d89e-4bf3-a17d-b485b7e43e84 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-44ea6528-60b4-4cc5-903c-36628c2b09f3 req-ecf79479-d89e-4bf3-a17d-b485b7e43e84 service nova] Acquiring lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-44ea6528-60b4-4cc5-903c-36628c2b09f3 req-ecf79479-d89e-4bf3-a17d-b485b7e43e84 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-44ea6528-60b4-4cc5-903c-36628c2b09f3 req-ecf79479-d89e-4bf3-a17d-b485b7e43e84 service nova] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-44ea6528-60b4-4cc5-903c-36628c2b09f3 req-ecf79479-d89e-4bf3-a17d-b485b7e43e84 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] No waiting events found dispatching network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:10 user nova-compute[73208]: WARNING nova.compute.manager [req-44ea6528-60b4-4cc5-903c-36628c2b09f3 req-ecf79479-d89e-4bf3-a17d-b485b7e43e84 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received unexpected event network-vif-plugged-c2285ef4-64f2-42cf-8995-04bc6ce4258c for instance with vm_state deleted and task_state None.
Aug 16 09:33:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-44ea6528-60b4-4cc5-903c-36628c2b09f3 req-ecf79479-d89e-4bf3-a17d-b485b7e43e84 service nova] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Received event network-vif-deleted-c2285ef4-64f2-42cf-8995-04bc6ce4258c {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:33:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:11 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Deleted allocations for instance abbf98e1-d609-49ab-8b7f-6b8d57f2718a
Aug 16 09:33:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-36bc8d9c-a1e6-4c5b-8bcc-6a61964e56d8 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "abbf98e1-d609-49ab-8b7f-6b8d57f2718a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.050s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:22 user nova-compute[73208]: INFO nova.compute.manager [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Detaching volume 32ed49e9-8db1-440c-87e7-d37cc25328dd
Aug 16 09:33:22 user nova-compute[73208]: INFO nova.virt.block_device [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attempting to driver detach volume 32ed49e9-8db1-440c-87e7-d37cc25328dd from mountpoint /dev/vdb
Aug 16 09:33:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Attempting to detach device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:33:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:33:22 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:33:22 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:33:22 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:33:22 user nova-compute[73208]:   <serial>32ed49e9-8db1-440c-87e7-d37cc25328dd</serial>
Aug 16 09:33:22 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:33:22 user nova-compute[73208]: </disk>
Aug 16 09:33:22 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:33:22 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully detached device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the persistent domain config.
Aug 16 09:33:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5067d00-0cd2-40f2-875f-577760762123 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:33:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:33:22 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:33:22 user nova-compute[73208]:   <source dev="/dev/sdd"/>
Aug 16 09:33:22 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:33:22 user nova-compute[73208]:   <serial>32ed49e9-8db1-440c-87e7-d37cc25328dd</serial>
Aug 16 09:33:22 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:33:22 user nova-compute[73208]: </disk>
Aug 16 09:33:22 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178403.2802966, f5067d00-0cd2-40f2-875f-577760762123 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:33:23 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully detached device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the live domain config.
Aug 16 09:33:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELcCnHAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:33:23 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dddf56-f419-4b08-acbc-2bd726e64216]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee7abe9-38ca-4d60-9dc9-1efeffe95c05]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:23 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:23 user nova-compute[73208]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)
Aug 16 09:33:23 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:23 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:23 user nova-compute[73208]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd (non-flash)
Aug 16 09:33:23 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f01fbbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd'): ({'sdd'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Removing single pathed devices sdd {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1555e49-4018-4a16-b187-c0b9b9b0fbcf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8d2f19-a19c-4554-91b0-ed65a30d9951]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Flushing IO for device /dev/sdd {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a63a9b8-0c25-4ab7-852d-fdf555b70c4a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f44b8c-6f01-407f-8fc7-d573d9ef03c0]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] SCSI volumes sdd have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba590cf7-b406-4a5c-ab3f-605e212f41b4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44fd8ba-324c-4f32-b8c6-fa50c98e2951]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd, portal: 172.16.0.220,3260]
Aug 16 09:33:23 user nova-compute[73208]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd, portal: 172.16.0.220,3260] successful.
Aug 16 09:33:23 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ed49e9-8db1-440c-87e7-d37cc25328dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d585b58d-16d0-42b4-8668-e9b1a9c60bdc]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== disconnect_volume: return (304ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178388.9243999, abbf98e1-d609-49ab-8b7f-6b8d57f2718a => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:33:23 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] VM Stopped (Lifecycle Event)
Aug 16 09:33:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-419e0b06-ef6a-4416-9403-b534cce89e82 None None] [instance: abbf98e1-d609-49ab-8b7f-6b8d57f2718a] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:33:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:24 user nova-compute[73208]: DEBUG nova.objects.instance [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:33:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-80821be5-6240-4fa9-8fb3-a130c97d68cf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-8265f673-4c72-466e-90e9-7faeb8c0f945 req-58c634c3-b496-4061-8f10-c8f56c661766 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received event network-changed-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-8265f673-4c72-466e-90e9-7faeb8c0f945 req-58c634c3-b496-4061-8f10-c8f56c661766 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Refreshing instance network info cache due to event network-changed-27010a0b-da80-4d5a-94a3-8858163d055a. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8265f673-4c72-466e-90e9-7faeb8c0f945 req-58c634c3-b496-4061-8f10-c8f56c661766 service nova] Acquiring lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8265f673-4c72-466e-90e9-7faeb8c0f945 req-58c634c3-b496-4061-8f10-c8f56c661766 service nova] Acquired lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-8265f673-4c72-466e-90e9-7faeb8c0f945 req-58c634c3-b496-4061-8f10-c8f56c661766 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Refreshing network info cache for port 27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-8265f673-4c72-466e-90e9-7faeb8c0f945 req-58c634c3-b496-4061-8f10-c8f56c661766 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Updated VIF entry in instance network info cache for port 27010a0b-da80-4d5a-94a3-8858163d055a. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-8265f673-4c72-466e-90e9-7faeb8c0f945 req-58c634c3-b496-4061-8f10-c8f56c661766 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Updating instance_info_cache with network_info: [{"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8265f673-4c72-466e-90e9-7faeb8c0f945 req-58c634c3-b496-4061-8f10-c8f56c661766 service nova] Releasing lock "refresh_cache-8a9c86f4-584f-4907-bd7f-ba28fcc686d4" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:33:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:31 user nova-compute[73208]: DEBUG nova.objects.instance [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:33:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:32 user nova-compute[73208]: INFO nova.compute.manager [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Attaching volume 8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 to /dev/vdb
Aug 16 09:33:32 user nova-compute[73208]: DEBUG os_brick.utils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b635e1d-6cde-4ffe-80e4-2f12f97d4231]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[13009345-a5bb-4c22-96d0-935e85f816d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[661760f7-9ac8-4a18-b204-fb3104140933]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e09403d-fabd-4c6b-9549-54af39fa08c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:33:32 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9857b5-2b64-4c50-a534-47371f2e3b8c]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG os_brick.utils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Updating existing volume attachment record: f7c549a7-bb6b-4e3c-9be0-5cf7ac93609c {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:33:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:33:35 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:33:35 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=7776MB free_disk=24.92105484008789GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance af45d645-fd93-4e44-9700-018b121659c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f5067d00-0cd2-40f2-875f-577760762123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 42f666e9-8880-42ac-9645-bf25038ca521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:33:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:36 user nova-compute[73208]: INFO nova.compute.manager [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Terminating instance
Aug 16 09:33:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-31880894-464c-4fa0-94f4-36dce6067e13 req-2f075dd5-d12e-471d-b414-fca0c9560a0a service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-31880894-464c-4fa0-94f4-36dce6067e13 req-2f075dd5-d12e-471d-b414-fca0c9560a0a service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-31880894-464c-4fa0-94f4-36dce6067e13 req-2f075dd5-d12e-471d-b414-fca0c9560a0a service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-31880894-464c-4fa0-94f4-36dce6067e13 req-2f075dd5-d12e-471d-b414-fca0c9560a0a service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-31880894-464c-4fa0-94f4-36dce6067e13 req-2f075dd5-d12e-471d-b414-fca0c9560a0a service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-31880894-464c-4fa0-94f4-36dce6067e13 req-2f075dd5-d12e-471d-b414-fca0c9560a0a service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] Instance destroyed successfully.
Aug 16 09:33:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lazy-loading 'resources' on Instance uuid af45d645-fd93-4e44-9700-018b121659c1 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-919633964',display_name='tempest-ServerStableDeviceRescueTest-server-919633964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-919633964',id=35,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0YU4/+Pf8WDx9dx6xIEfPvH/hVAaKk5212Crjq+ypMbUf9I0vNMOG02Jqpqdo7FDE0YgmrXTqjccKYYVYDAQ1JC152XLZ6tzpbdqjRE4VfzMz/CT8MRHCCY2U4P0Lk7g==',key_name='tempest-keypair-835774011',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:30:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1964699a248443e68e8ccd09b454c668',ramdisk_id='',reservation_id='r-d674ii0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-513168018',owner_user_name='tempest-ServerStableDeviceRescueTest-513168018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:32:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a31cfa72d13427b896669c9ba5f0832',uuid=af45d645-fd93-4e44-9700-018b121659c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Converting VIF {"id": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "address": "fa:16:3e:13:93:22", "network": {"id": "ac16d50f-8088-4e9a-87af-e3cddb7e0ce1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1007366660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1964699a248443e68e8ccd09b454c668", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b20c094-a0", "ovs_interfaceid": "8b20c094-a0f7-4c34-a98d-d2938c3ebb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:93:22,bridge_name='br-int',has_traffic_filtering=True,id=8b20c094-a0f7-4c34-a98d-d2938c3ebb28,network=Network(ac16d50f-8088-4e9a-87af-e3cddb7e0ce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b20c094-a0') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG os_vif [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:93:22,bridge_name='br-int',has_traffic_filtering=True,id=8b20c094-a0f7-4c34-a98d-d2938c3ebb28,network=Network(ac16d50f-8088-4e9a-87af-e3cddb7e0ce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b20c094-a0') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b20c094-a0, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: INFO os_vif [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:93:22,bridge_name='br-int',has_traffic_filtering=True,id=8b20c094-a0f7-4c34-a98d-d2938c3ebb28,network=Network(ac16d50f-8088-4e9a-87af-e3cddb7e0ce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b20c094-a0')
Aug 16 09:33:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Deleting instance files /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1_del
Aug 16 09:33:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Deletion of /opt/stack/data/nova/instances/af45d645-fd93-4e44-9700-018b121659c1_del complete
Aug 16 09:33:37 user nova-compute[73208]: INFO nova.compute.manager [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] [instance: af45d645-fd93-4e44-9700-018b121659c1] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 09:33:37 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:33:38 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] Took 1.38 seconds to deallocate network for instance.
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:38 user nova-compute[73208]: WARNING nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state deleted and task_state None.
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:38 user nova-compute[73208]: WARNING nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state deleted and task_state None.
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:38 user nova-compute[73208]: WARNING nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state deleted and task_state None.
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:38 user nova-compute[73208]: WARNING nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-unplugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state deleted and task_state None.
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-0e797c75-95b8-4370-80f2-4537e5cf441f req-af2a17e6-a76d-4ddb-a2d8-ba543bca02d3 service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-deleted-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:33:38 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:33:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:39 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Deleted allocations for instance af45d645-fd93-4e44-9700-018b121659c1
Aug 16 09:33:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-71822554-e33f-4cf5-a4ae-3eeaeed86f82 tempest-ServerStableDeviceRescueTest-513168018 tempest-ServerStableDeviceRescueTest-513168018-project-member] Lock "af45d645-fd93-4e44-9700-018b121659c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-d0cc0b63-56ac-45c9-a226-034a0b7d26c4 req-5e700572-9feb-4775-8998-9feb3fffef4a service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0cc0b63-56ac-45c9-a226-034a0b7d26c4 req-5e700572-9feb-4775-8998-9feb3fffef4a service nova] Acquiring lock "af45d645-fd93-4e44-9700-018b121659c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0cc0b63-56ac-45c9-a226-034a0b7d26c4 req-5e700572-9feb-4775-8998-9feb3fffef4a service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d0cc0b63-56ac-45c9-a226-034a0b7d26c4 req-5e700572-9feb-4775-8998-9feb3fffef4a service nova] Lock "af45d645-fd93-4e44-9700-018b121659c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-d0cc0b63-56ac-45c9-a226-034a0b7d26c4 req-5e700572-9feb-4775-8998-9feb3fffef4a service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] No waiting events found dispatching network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:40 user nova-compute[73208]: WARNING nova.compute.manager [req-d0cc0b63-56ac-45c9-a226-034a0b7d26c4 req-5e700572-9feb-4775-8998-9feb3fffef4a service nova] [instance: af45d645-fd93-4e44-9700-018b121659c1] Received unexpected event network-vif-plugged-8b20c094-a0f7-4c34-a98d-d2938c3ebb28 for instance with vm_state deleted and task_state None.
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MpxGlVOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:33:42 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:33:42 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:33:42 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[64966511-bde6-469a-9a17-d1fa07e66701]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:33:42 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f37c8f-3477-440e-b4e2-761e1d2d4632]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85] added
Aug 16 09:33:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a70117b-2d11-4b0b-b3c4-91accf509135]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf5448-99b3-467d-aabc-2dd337eca26e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MpxGlVOK {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MpxGlVOK" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[301e99ee-a940-4b1b-b9c4-e798b1aa5397]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MpxGlVOK'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba8733f-1088-4d76-9e58-bc8578c9e387]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0661d57-c696-4201-960d-386217702d77]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b920d3a6-141d-4f1b-a1d3-a7fc15b7bb02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85, portal: 172.16.0.220,3260]
Aug 16 09:33:42 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85, portal: 172.16.0.220,3260] successful.
Aug 16 09:33:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3606565-9963-4893-ae1f-d5f72caa27df]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c4a441-6e57-4252-9fd0-f37d1812fd78]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 (non-flash)
Aug 16 09:33:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e60d2f-2e1f-46f8-a81b-939b02f845a8]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:33:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:33:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MpxGlVOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:33:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:33:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23337306230346239', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:33:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337306230346239', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:33:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:33:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:33:43 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:33:43 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:33:43 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:33:43 user nova-compute[73208]:   <serial>8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85</serial>
Aug 16 09:33:43 user nova-compute[73208]: </disk>
Aug 16 09:33:43 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:33:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:33:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:33:44 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] No VIF found with MAC fa:16:3e:12:75:9b, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:33:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-45c8b4b8-c52f-489f-b4a0-295f49e45b10 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.410s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:45 user nova-compute[73208]: INFO nova.compute.manager [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Detaching volume 8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85
Aug 16 09:33:45 user nova-compute[73208]: INFO nova.virt.block_device [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Attempting to driver detach volume 8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 from mountpoint /dev/vdb
Aug 16 09:33:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Attempting to detach device vdb from instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:33:45 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:33:45 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:33:45 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:33:45 user nova-compute[73208]:   <serial>8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85</serial>
Aug 16 09:33:45 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:33:45 user nova-compute[73208]: </disk>
Aug 16 09:33:45 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:33:45 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully detached device vdb from instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 from the persistent domain config.
Aug 16 09:33:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:33:45 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:33:45 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:33:45 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:33:45 user nova-compute[73208]:   <serial>8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85</serial>
Aug 16 09:33:45 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:33:45 user nova-compute[73208]: </disk>
Aug 16 09:33:45 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178425.6765969, 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:33:45 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully detached device vdb from instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 from the live domain config.
Aug 16 09:33:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MpxGlVOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:33:45 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60239b2-56e7-424c-b32a-5c372ee3b14f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1db21c3-3afe-40b3-bbc5-069cd6f2a45d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:45 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:45 user nova-compute[73208]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 (non-flash)
Aug 16 09:33:45 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:45 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:45 user nova-compute[73208]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 (non-flash)
Aug 16 09:33:45 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d027f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7d3edd-83f0-4668-884f-6bd9484ece89]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9e80a7-6a1c-4547-933c-a6cd42ad8665]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[78668c87-b927-46e7-81d4-2a353d7e20b8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80d59b9-6775-429a-ae51-4d02c586f850]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fb9918-0d71-4649-b150-408dc73226e2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd9232-f38e-47fa-a9db-001c51b5c660]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85, portal: 172.16.0.220,3260]
Aug 16 09:33:45 user nova-compute[73208]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85, portal: 172.16.0.220,3260] successful.
Aug 16 09:33:45 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc1eb20-e507-4a6b-aa5d-6d0c2a6ecb85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[86953f2c-3534-41e2-878f-a07747b22878]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] <== disconnect_volume: return (290ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:33:45 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:33:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:46 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'flavor' on Instance uuid 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:33:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6fa338e1-ab64-4d3a-99b5-b33dc3bacb1d tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-ceddefa2-a93e-4ae2-861e-c63138a7b57a req-60850c57-45ee-4d93-9f6a-64bdcf1a5fe5 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-ceddefa2-a93e-4ae2-861e-c63138a7b57a req-60850c57-45ee-4d93-9f6a-64bdcf1a5fe5 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing instance network info cache due to event network-changed-33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ceddefa2-a93e-4ae2-861e-c63138a7b57a req-60850c57-45ee-4d93-9f6a-64bdcf1a5fe5 service nova] Acquiring lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ceddefa2-a93e-4ae2-861e-c63138a7b57a req-60850c57-45ee-4d93-9f6a-64bdcf1a5fe5 service nova] Acquired lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG nova.network.neutron [req-ceddefa2-a93e-4ae2-861e-c63138a7b57a req-60850c57-45ee-4d93-9f6a-64bdcf1a5fe5 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Refreshing network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:51 user nova-compute[73208]: INFO nova.compute.manager [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Terminating instance
Aug 16 09:33:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-732c1364-7ba2-42ca-8b17-16dce26fb455 req-fb126c9c-8d5c-4399-8fd8-c36ed0a7198c service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-unplugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-732c1364-7ba2-42ca-8b17-16dce26fb455 req-fb126c9c-8d5c-4399-8fd8-c36ed0a7198c service nova] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-732c1364-7ba2-42ca-8b17-16dce26fb455 req-fb126c9c-8d5c-4399-8fd8-c36ed0a7198c service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-732c1364-7ba2-42ca-8b17-16dce26fb455 req-fb126c9c-8d5c-4399-8fd8-c36ed0a7198c service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-732c1364-7ba2-42ca-8b17-16dce26fb455 req-fb126c9c-8d5c-4399-8fd8-c36ed0a7198c service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] No waiting events found dispatching network-vif-unplugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-732c1364-7ba2-42ca-8b17-16dce26fb455 req-fb126c9c-8d5c-4399-8fd8-c36ed0a7198c service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-unplugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-ceddefa2-a93e-4ae2-861e-c63138a7b57a req-60850c57-45ee-4d93-9f6a-64bdcf1a5fe5 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updated VIF entry in instance network info cache for port 33df2ec9-e747-45f1-b34a-03b6dd017cd7. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-ceddefa2-a93e-4ae2-861e-c63138a7b57a req-60850c57-45ee-4d93-9f6a-64bdcf1a5fe5 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [{"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ceddefa2-a93e-4ae2-861e-c63138a7b57a req-60850c57-45ee-4d93-9f6a-64bdcf1a5fe5 service nova] Releasing lock "refresh_cache-aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178417.1516104, af45d645-fd93-4e44-9700-018b121659c1 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:33:52 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: af45d645-fd93-4e44-9700-018b121659c1] VM Stopped (Lifecycle Event)
Aug 16 09:33:52 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Instance destroyed successfully.
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lazy-loading 'resources' on Instance uuid aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-68e3ccad-9d2d-45dc-abba-1c19fa6337e1 None None] [instance: af45d645-fd93-4e44-9700-018b121659c1] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T09:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-520207354',display_name='tempest-TestShelveInstance-server-520207354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-520207354',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTxujKSCteZ5P6lR4UwzRys67W8lMq/TyHdhvHBTlgZ+s9EYE4Ik7pvRHc0oNFhtBuedzNM172/eZhL3HuwHksgGZahHrqHdc9j4QckywqYhlcoHYVKroFDwgKNX74Kgg==',key_name='tempest-TestShelveInstance-1927113377',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21041c92f02043e0baa0f6abeadcd78e',ramdisk_id='',reservation_id='r-g3kxydmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1402301442',owner_user_name='tempest-TestShelveInstance-1402301442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:32:20Z,user_data=None,user_id='f9014d0cab7e416fa4e030653fd4b01d',uuid=aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converting VIF {"id": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "address": "fa:16:3e:54:bb:79", "network": {"id": "692e8484-ae87-429e-a1b2-0e90383589c3", "bridge": "br-int", "label": "tempest-TestShelveInstance-815419965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21041c92f02043e0baa0f6abeadcd78e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33df2ec9-e7", "ovs_interfaceid": "33df2ec9-e747-45f1-b34a-03b6dd017cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_vif [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33df2ec9-e7, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:33:52 user nova-compute[73208]: INFO os_vif [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:bb:79,bridge_name='br-int',has_traffic_filtering=True,id=33df2ec9-e747-45f1-b34a-03b6dd017cd7,network=Network(692e8484-ae87-429e-a1b2-0e90383589c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33df2ec9-e7')
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWDtyxEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:33:52 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aef8d90-42cb-4203-b502-35cf18bde184]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf417ba-4ce2-4c5b-a19e-b43395ddc6a2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:52 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:33:52 user nova-compute[73208]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 (non-flash)
Aug 16 09:33:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d015f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589'): ({'sde'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Removing single pathed devices sde {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7048fca1-e511-4469-95be-c9c09789f491]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f278b11-8b03-450b-837f-5ecb894f445e]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Flushing IO for device /dev/sde {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[df236fc3-b0b2-43db-b1f1-fff17f7f9316]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14925a-f08e-4762-a996-d7f942e2bc9c]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] SCSI volumes sde have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOceff90a5-67795820c08615e4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ceff90a5', '/dev/disk/by-id/scsi-23637373935383230') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb57ee16-e608-4cfd-a2b2-1cc21e7c2796]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c215f8-17a9-45e1-b2fc-519a537d5388]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[376d1065-1c37-4481-9ca9-70f57339e199]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260]
Aug 16 09:33:52 user nova-compute[73208]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589, portal: 172.16.0.220,3260] successful.
Aug 16 09:33:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac69d2fd-e25a-4976-b618-65c6280a3589 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ead56a-10eb-4df5-9124-eaee20da7cd6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] <== disconnect_volume: return (287ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:33:52 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Deleting instance files /opt/stack/data/nova/instances/aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727_del
Aug 16 09:33:52 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Deletion of /opt/stack/data/nova/instances/aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727_del complete
Aug 16 09:33:52 user nova-compute[73208]: INFO nova.compute.manager [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 16 09:33:52 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:33:52 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:33:53 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:33:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-d699bca6-94ff-4585-aadd-bd6b236f7055 req-a3eedefe-6648-4552-994c-a0575c6544e3 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-deleted-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:53 user nova-compute[73208]: INFO nova.compute.manager [req-d699bca6-94ff-4585-aadd-bd6b236f7055 req-a3eedefe-6648-4552-994c-a0575c6544e3 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Neutron deleted interface 33df2ec9-e747-45f1-b34a-03b6dd017cd7; detaching it from the instance and deleting it from the info cache
Aug 16 09:33:53 user nova-compute[73208]: DEBUG nova.network.neutron [req-d699bca6-94ff-4585-aadd-bd6b236f7055 req-a3eedefe-6648-4552-994c-a0575c6544e3 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:33:53 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Took 1.21 seconds to deallocate network for instance.
Aug 16 09:33:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-25656cdc-e7f2-430c-a493-31c951132823 req-10f174de-9d56-45a2-b6b9-f6240271994f service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-25656cdc-e7f2-430c-a493-31c951132823 req-10f174de-9d56-45a2-b6b9-f6240271994f service nova] Acquiring lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-25656cdc-e7f2-430c-a493-31c951132823 req-10f174de-9d56-45a2-b6b9-f6240271994f service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-25656cdc-e7f2-430c-a493-31c951132823 req-10f174de-9d56-45a2-b6b9-f6240271994f service nova] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-25656cdc-e7f2-430c-a493-31c951132823 req-10f174de-9d56-45a2-b6b9-f6240271994f service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] No waiting events found dispatching network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:53 user nova-compute[73208]: WARNING nova.compute.manager [req-25656cdc-e7f2-430c-a493-31c951132823 req-10f174de-9d56-45a2-b6b9-f6240271994f service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Received unexpected event network-vif-plugged-33df2ec9-e747-45f1-b34a-03b6dd017cd7 for instance with vm_state active and task_state deleting.
Aug 16 09:33:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-d699bca6-94ff-4585-aadd-bd6b236f7055 req-a3eedefe-6648-4552-994c-a0575c6544e3 service nova] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Detach interface failed, port_id=33df2ec9-e747-45f1-b34a-03b6dd017cd7, reason: Instance aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:33:54 user nova-compute[73208]: INFO nova.compute.manager [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 09:33:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Deleting volume: ac69d2fd-e25a-4976-b618-65c6280a3589 {{(pid=73208) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 09:33:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:54 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:33:54 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:33:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:54 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Deleted allocations for instance aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727
Aug 16 09:33:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-04fc3ea0-5453-4e95-ac9f-6d1e21b305ba tempest-TestShelveInstance-1402301442 tempest-TestShelveInstance-1402301442-project-member] Lock "aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.587s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:59 user nova-compute[73208]: INFO nova.compute.manager [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Terminating instance
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-f81a9bcc-fdf2-42a8-b7f8-5ec85d673b25 req-1504e99c-4bdc-468a-ba80-402fe8b08fcc service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received event network-vif-unplugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f81a9bcc-fdf2-42a8-b7f8-5ec85d673b25 req-1504e99c-4bdc-468a-ba80-402fe8b08fcc service nova] Acquiring lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f81a9bcc-fdf2-42a8-b7f8-5ec85d673b25 req-1504e99c-4bdc-468a-ba80-402fe8b08fcc service nova] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f81a9bcc-fdf2-42a8-b7f8-5ec85d673b25 req-1504e99c-4bdc-468a-ba80-402fe8b08fcc service nova] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-f81a9bcc-fdf2-42a8-b7f8-5ec85d673b25 req-1504e99c-4bdc-468a-ba80-402fe8b08fcc service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] No waiting events found dispatching network-vif-unplugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-f81a9bcc-fdf2-42a8-b7f8-5ec85d673b25 req-1504e99c-4bdc-468a-ba80-402fe8b08fcc service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received event network-vif-unplugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:33:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Instance destroyed successfully.
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.objects.instance [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'resources' on Instance uuid 0b6a305b-662e-4498-ac23-99ccfe1fca4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-723967379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-723967379',id=33,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-m8do8f2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:26:33Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=0b6a305b-662e-4498-ac23-99ccfe1fca4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "address": "fa:16:3e:80:55:ec", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8626e65-b5", "ovs_interfaceid": "c8626e65-b5f0-48eb-81d4-d2b819fa0580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:55:ec,bridge_name='br-int',has_traffic_filtering=True,id=c8626e65-b5f0-48eb-81d4-d2b819fa0580,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8626e65-b5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG os_vif [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:55:ec,bridge_name='br-int',has_traffic_filtering=True,id=c8626e65-b5f0-48eb-81d4-d2b819fa0580,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8626e65-b5') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8626e65-b5, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:33:59 user nova-compute[73208]: INFO os_vif [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:55:ec,bridge_name='br-int',has_traffic_filtering=True,id=c8626e65-b5f0-48eb-81d4-d2b819fa0580,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8626e65-b5')
Aug 16 09:33:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Deleting instance files /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f_del
Aug 16 09:33:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Deletion of /opt/stack/data/nova/instances/0b6a305b-662e-4498-ac23-99ccfe1fca4f_del complete
Aug 16 09:33:59 user nova-compute[73208]: INFO nova.compute.manager [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 09:33:59 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:33:59 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:34:00 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:34:00 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Took 0.44 seconds to deallocate network for instance.
Aug 16 09:34:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:00 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:34:00 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:34:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:00 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Deleted allocations for instance 0b6a305b-662e-4498-ac23-99ccfe1fca4f
Aug 16 09:34:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b148ee3-b277-43b2-9808-90e145d53b50 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.724s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-1658c771-425d-4993-b581-7f3effc96bb2 req-b01fc521-4744-4762-a77d-a7287f8683a0 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received event network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1658c771-425d-4993-b581-7f3effc96bb2 req-b01fc521-4744-4762-a77d-a7287f8683a0 service nova] Acquiring lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1658c771-425d-4993-b581-7f3effc96bb2 req-b01fc521-4744-4762-a77d-a7287f8683a0 service nova] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1658c771-425d-4993-b581-7f3effc96bb2 req-b01fc521-4744-4762-a77d-a7287f8683a0 service nova] Lock "0b6a305b-662e-4498-ac23-99ccfe1fca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-1658c771-425d-4993-b581-7f3effc96bb2 req-b01fc521-4744-4762-a77d-a7287f8683a0 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] No waiting events found dispatching network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:34:01 user nova-compute[73208]: WARNING nova.compute.manager [req-1658c771-425d-4993-b581-7f3effc96bb2 req-b01fc521-4744-4762-a77d-a7287f8683a0 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received unexpected event network-vif-plugged-c8626e65-b5f0-48eb-81d4-d2b819fa0580 for instance with vm_state deleted and task_state None.
Aug 16 09:34:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-1658c771-425d-4993-b581-7f3effc96bb2 req-b01fc521-4744-4762-a77d-a7287f8683a0 service nova] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Received event network-vif-deleted-c8626e65-b5f0-48eb-81d4-d2b819fa0580 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:07 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178432.1522949, aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:34:07 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] VM Stopped (Lifecycle Event)
Aug 16 09:34:07 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e3853c70-29a2-45ca-be03-3b5e6ac5b484 None None] [instance: aaeb695b-6cc6-4b2a-89c4-eb0ccd5fc727] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:34:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:34:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:34:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:34:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:34:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:14 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178439.8191423, 0b6a305b-662e-4498-ac23-99ccfe1fca4f => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:34:14 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] VM Stopped (Lifecycle Event)
Aug 16 09:34:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-07199318-07a8-4392-906e-c7ce24963d41 None None] [instance: 0b6a305b-662e-4498-ac23-99ccfe1fca4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:34:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:34:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:16 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:34:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:17 user nova-compute[73208]: INFO nova.compute.manager [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attaching volume f425d42a-ec4c-4173-ae65-3e089c5d4a1c to /dev/vdb
Aug 16 09:34:17 user nova-compute[73208]: DEBUG os_brick.utils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3955cb16-727f-40b1-a567-681430cad3f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[da99201c-30f1-478d-ada9-45cf48477847]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8cebec-0827-4b6c-b7ee-9c04da5034fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea947ad8-343e-4dfa-862d-34a4a9bc89cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:34:17 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:34:17 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d17411e-3ae2-4b6d-a2d7-1d7871bf0bb8]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG os_brick.utils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:34:17 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating existing volume attachment record: f1826b95-c5ab-44f4-a44d-ebdee380a41c {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:34:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:34:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLOrEtFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:34:26 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:34:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:34:26 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:34:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:34:26 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:34:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[432ec9b1-e50b-4f15-8655-2f49c0e838a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:34:26 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aef0eb-64b3-4fd6-96af-13fce685f21a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c] added
Aug 16 09:34:26 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[18faef3d-11d0-4324-b578-188594ad71bf]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb36f1a-16a4-4cdc-9dfd-9df9ae4b4e8b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLOrEtFx {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLOrEtFx" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eead40d-6c42-4233-a3b9-fa32b8a3152b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DLOrEtFx'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c0f09-f253-4c0f-b297-f3c128ea9f16]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d0601-dd50-4bd6-97f7-8600a5226a29]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ec161c-57c4-4a68-ac02-44b8d3137576]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c, portal: 172.16.0.220,3260]
Aug 16 09:34:27 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c, portal: 172.16.0.220,3260] successful.
Aug 16 09:34:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc75becc-11eb-4ba7-916d-d7396cbc6f84]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fe1b92-8870-40d5-96b1-36369e3e9bdb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:27 user nova-compute[73208]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c (non-flash)
Aug 16 09:34:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:27 user nova-compute[73208]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c (non-flash)
Aug 16 09:34:27 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[601fd7c4-ecfd-4811-b390-899d00ed45b9]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:34:27 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLOrEtFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23031626161363166', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031626161363166', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:34:28 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:34:28 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:34:28 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:34:28 user nova-compute[73208]:   <serial>f425d42a-ec4c-4173-ae65-3e089c5d4a1c</serial>
Aug 16 09:34:28 user nova-compute[73208]: </disk>
Aug 16 09:34:28 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No VIF found with MAC fa:16:3e:0e:b5:ea, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:34:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f75243a2-57f3-4288-91c4-2176e5b44aba tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.793s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG nova.objects.instance [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'flavor' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:30 user nova-compute[73208]: INFO nova.compute.manager [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Attaching volume 70c838e4-7977-495d-97fb-d3f6e05f7f8f to /dev/vdb
Aug 16 09:34:30 user nova-compute[73208]: DEBUG os_brick.utils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b3484-8007-4a0e-b56e-275a3e36a357]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dd0b32-2f59-40bc-88f4-ecbc4ba09a13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0958b015-cc06-4c36-be4a-cfcd32c6b18b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[607be2f9-4e3d-4e38-a718-496d78fe50f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:34:30 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:34:30 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce18a0c-9da0-4758-8f21-26e675355c46]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG os_brick.utils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:34:30 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating existing volume attachment record: 72037d0a-3813-40cf-b6f5-1e20ea5d7e10 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:34:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:31 user nova-compute[73208]: INFO nova.compute.manager [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Detaching volume f425d42a-ec4c-4173-ae65-3e089c5d4a1c
Aug 16 09:34:31 user nova-compute[73208]: INFO nova.virt.block_device [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attempting to driver detach volume f425d42a-ec4c-4173-ae65-3e089c5d4a1c from mountpoint /dev/vdb
Aug 16 09:34:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Attempting to detach device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:34:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:34:31 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:34:31 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:34:31 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:34:31 user nova-compute[73208]:   <serial>f425d42a-ec4c-4173-ae65-3e089c5d4a1c</serial>
Aug 16 09:34:31 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:34:31 user nova-compute[73208]: </disk>
Aug 16 09:34:31 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:34:31 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully detached device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the persistent domain config.
Aug 16 09:34:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5067d00-0cd2-40f2-875f-577760762123 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:34:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:34:31 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:34:31 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:34:31 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:34:31 user nova-compute[73208]:   <serial>f425d42a-ec4c-4173-ae65-3e089c5d4a1c</serial>
Aug 16 09:34:31 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:34:31 user nova-compute[73208]: </disk>
Aug 16 09:34:31 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:34:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178471.9861786, f5067d00-0cd2-40f2-875f-577760762123 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:34:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:34:31 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully detached device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the live domain config.
Aug 16 09:34:31 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:34:31 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLOrEtFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:34:31 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[559788e4-81fc-445a-981c-b352eac6a421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfb2416-8f98-437d-a73e-774261c11ac1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:32 user nova-compute[73208]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c (non-flash)
Aug 16 09:34:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:32 user nova-compute[73208]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c (non-flash)
Aug 16 09:34:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d033ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d941736-14e2-487d-9733-d8e9633d9d38]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[edff5b32-35bb-4a38-8468-e72e5d1f238b]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3234a718-073b-41f9-8f5d-1bc5c214e9c9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[836a012b-2413-4577-b1c4-6a5e44862ee0]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e052f9-f381-42df-b4c7-75a0c764ae4e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb375f4-19ae-4416-a84b-4d11d7537b6b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c, portal: 172.16.0.220,3260]
Aug 16 09:34:32 user nova-compute[73208]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c, portal: 172.16.0.220,3260] successful.
Aug 16 09:34:32 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f425d42a-ec4c-4173-ae65-3e089c5d4a1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe3f17e-5a51-41c5-83c3-eea518da296e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== disconnect_volume: return (257ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG nova.objects.instance [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-21db066e-3ffc-41ae-974d-5f833a5d5f74 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:34:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:34 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:34:34 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:34:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8189MB free_disk=25.1536865234375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:34:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 6b259ec1-e74b-4255-aedf-685818f23c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f5067d00-0cd2-40f2-875f-577760762123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 42f666e9-8880-42ac-9645-bf25038ca521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:35 user nova-compute[73208]: INFO nova.compute.manager [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Terminating instance
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-04aba33f-b1c9-4d94-aa13-c45e9209ac5e req-d392e98c-8132-4673-8ec2-70518efc15b2 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received event network-vif-unplugged-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04aba33f-b1c9-4d94-aa13-c45e9209ac5e req-d392e98c-8132-4673-8ec2-70518efc15b2 service nova] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04aba33f-b1c9-4d94-aa13-c45e9209ac5e req-d392e98c-8132-4673-8ec2-70518efc15b2 service nova] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-04aba33f-b1c9-4d94-aa13-c45e9209ac5e req-d392e98c-8132-4673-8ec2-70518efc15b2 service nova] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-04aba33f-b1c9-4d94-aa13-c45e9209ac5e req-d392e98c-8132-4673-8ec2-70518efc15b2 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] No waiting events found dispatching network-vif-unplugged-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:34:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-04aba33f-b1c9-4d94-aa13-c45e9209ac5e req-d392e98c-8132-4673-8ec2-70518efc15b2 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received event network-vif-unplugged-27010a0b-da80-4d5a-94a3-8858163d055a for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:36 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Instance destroyed successfully.
Aug 16 09:34:36 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lazy-loading 'resources' on Instance uuid 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:31:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1456937127',display_name='tempest-AttachVolumeNegativeTest-server-1456937127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1456937127',id=41,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn/crvrQLax0+5G5LX8U7TjmKlQLh+uTCgxbZrm41FBGePGenSnaMj5j69mPrT+/Aj6Ilr9vZsWSd9oszTwP1LeBlvBQ7XdTISNfztd791Lw/RQmORiWvPhss3/zsDrTw==',key_name='tempest-keypair-803189121',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:31:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12301729e76a42afa0c8923d3d428cac',ramdisk_id='',reservation_id='r-7ot8mpgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-657236303',owner_user_name='tempest-AttachVolumeNegativeTest-657236303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18737770cdee43d6a782ebbbd311e8fc',uuid=8a9c86f4-584f-4907-bd7f-ba28fcc686d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converting VIF {"id": "27010a0b-da80-4d5a-94a3-8858163d055a", "address": "fa:16:3e:12:75:9b", "network": {"id": "0cdc1065-d805-4ab2-972e-ff421b162e01", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-179197337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12301729e76a42afa0c8923d3d428cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27010a0b-da", "ovs_interfaceid": "27010a0b-da80-4d5a-94a3-8858163d055a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:75:9b,bridge_name='br-int',has_traffic_filtering=True,id=27010a0b-da80-4d5a-94a3-8858163d055a,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27010a0b-da') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG os_vif [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:75:9b,bridge_name='br-int',has_traffic_filtering=True,id=27010a0b-da80-4d5a-94a3-8858163d055a,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27010a0b-da') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27010a0b-da, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:36 user nova-compute[73208]: INFO os_vif [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:75:9b,bridge_name='br-int',has_traffic_filtering=True,id=27010a0b-da80-4d5a-94a3-8858163d055a,network=Network(0cdc1065-d805-4ab2-972e-ff421b162e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27010a0b-da')
Aug 16 09:34:36 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Deleting instance files /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4_del
Aug 16 09:34:36 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Deletion of /opt/stack/data/nova/instances/8a9c86f4-584f-4907-bd7f-ba28fcc686d4_del complete
Aug 16 09:34:36 user nova-compute[73208]: INFO nova.compute.manager [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 09:34:36 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:34:36 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:34:37 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-b66f75ad-09be-46b8-877d-cb245930c3ea req-86c6db0c-624c-4977-9a71-22d815412364 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received event network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b66f75ad-09be-46b8-877d-cb245930c3ea req-86c6db0c-624c-4977-9a71-22d815412364 service nova] Acquiring lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b66f75ad-09be-46b8-877d-cb245930c3ea req-86c6db0c-624c-4977-9a71-22d815412364 service nova] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b66f75ad-09be-46b8-877d-cb245930c3ea req-86c6db0c-624c-4977-9a71-22d815412364 service nova] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-b66f75ad-09be-46b8-877d-cb245930c3ea req-86c6db0c-624c-4977-9a71-22d815412364 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] No waiting events found dispatching network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:34:37 user nova-compute[73208]: WARNING nova.compute.manager [req-b66f75ad-09be-46b8-877d-cb245930c3ea req-86c6db0c-624c-4977-9a71-22d815412364 service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received unexpected event network-vif-plugged-27010a0b-da80-4d5a-94a3-8858163d055a for instance with vm_state active and task_state deleting.
Aug 16 09:34:37 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:34:37 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Took 1.60 seconds to deallocate network for instance.
Aug 16 09:34:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:38 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Deleted allocations for instance 8a9c86f4-584f-4907-bd7f-ba28fcc686d4
Aug 16 09:34:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c60af09d-2fb4-418f-86d8-2fc9988e9e33 tempest-AttachVolumeNegativeTest-657236303 tempest-AttachVolumeNegativeTest-657236303-project-member] Lock "8a9c86f4-584f-4907-bd7f-ba28fcc686d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.908s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-77e7ccc5-8b57-4c5b-a2c8-d55d83addd11 req-3f0d9a75-f9c4-47e1-8dab-0211bf92bcda service nova] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Received event network-vif-deleted-27010a0b-da80-4d5a-94a3-8858163d055a {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:34:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFfDKOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:34:40 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:34:40 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:34:40 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba8ebfc-2ad8-448f-a51d-64fef8f086b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:34:40 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a3371-64b6-4891-aae5-0b9196fefd29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f] added
Aug 16 09:34:40 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[196bcb27-be4c-454c-98d5-49476d6f6d68]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[43428315-c3cd-4604-ac02-b4e8ab630ca1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlFfDKOC {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlFfDKOC" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e9b48-bb91-4ed8-a0a1-43599bc5643d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlFfDKOC'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc97a4-b562-4781-b78f-4aef347b7d73]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[417e8d15-1496-4753-bff1-ecd185ff734d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[687cd27d-af3f-4ac3-a85d-1cdbe566f72d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260]
Aug 16 09:34:41 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260] successful.
Aug 16 09:34:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7621174-ed2b-41fb-9498-a50f547d9e6b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b8d0e-02c0-49fc-b0e1-ad285c20ea10]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:41 user nova-compute[73208]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:34:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:41 user nova-compute[73208]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:34:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9302a7-b35b-487a-801e-34aa609f1b2f]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:34:41 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid e23ec51a-a5cb-451b-91aa-f2b241d2b0cd {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFfDKOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23964353634386236', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964353634386236', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG nova.objects.instance [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'flavor' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:34:42 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:34:42 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:34:42 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:34:42 user nova-compute[73208]:   <serial>70c838e4-7977-495d-97fb-d3f6e05f7f8f</serial>
Aug 16 09:34:42 user nova-compute[73208]: </disk>
Aug 16 09:34:42 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updating instance_info_cache with network_info: [{"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No VIF found with MAC fa:16:3e:fc:19:56, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:34:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-753c8c2b-354e-4ca3-9203-1a54dd150ef9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.348s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:43 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:43 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:34:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "6b259ec1-e74b-4255-aedf-685818f23c76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:49 user nova-compute[73208]: INFO nova.compute.manager [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Terminating instance
Aug 16 09:34:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:34:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-4e05184d-48b4-452e-91da-0f14959947e8 req-866ed6b5-d7f5-4a8a-b12c-266a28e55fd1 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4e05184d-48b4-452e-91da-0f14959947e8 req-866ed6b5-d7f5-4a8a-b12c-266a28e55fd1 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4e05184d-48b4-452e-91da-0f14959947e8 req-866ed6b5-d7f5-4a8a-b12c-266a28e55fd1 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4e05184d-48b4-452e-91da-0f14959947e8 req-866ed6b5-d7f5-4a8a-b12c-266a28e55fd1 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-4e05184d-48b4-452e-91da-0f14959947e8 req-866ed6b5-d7f5-4a8a-b12c-266a28e55fd1 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.compute.manager [req-4e05184d-48b4-452e-91da-0f14959947e8 req-866ed6b5-d7f5-4a8a-b12c-266a28e55fd1 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-unplugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Instance destroyed successfully.
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'resources' on Instance uuid 6b259ec1-e74b-4255-aedf-685818f23c76 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-225187500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-225187500',id=27,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-oar6memn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:22:48Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=6b259ec1-e74b-4255-aedf-685818f23c76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "address": "fa:16:3e:e6:98:27", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c240e8-e3", "ovs_interfaceid": "94c240e8-e39e-4f10-ba85-8d3e4126a2a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:98:27,bridge_name='br-int',has_traffic_filtering=True,id=94c240e8-e39e-4f10-ba85-8d3e4126a2a4,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c240e8-e3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_vif [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:98:27,bridge_name='br-int',has_traffic_filtering=True,id=94c240e8-e39e-4f10-ba85-8d3e4126a2a4,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c240e8-e3') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c240e8-e3, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:34:50 user nova-compute[73208]: INFO os_vif [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:98:27,bridge_name='br-int',has_traffic_filtering=True,id=94c240e8-e39e-4f10-ba85-8d3e4126a2a4,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c240e8-e3')
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MewZbGpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:34:50 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d203c4-9228-4c1e-85a8-3b7d81aff69d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fb7dec-71e7-408b-a442-99acf6406ada]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:50 user nova-compute[73208]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:34:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 (non-flash)
Aug 16 09:34:50 user nova-compute[73208]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:34:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d015d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2383514-19c6-4b5f-9c7d-d31366e93f43]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fdceaa-ba2a-4ff7-a969-dae96e88b7b0]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22de79d-446b-45eb-ad4f-f19051d3b976]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb8d214-c274-468f-8eec-97ed0c483a1b]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ce9daf-1203-4348-a3d1-d55f633a896a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d3b40-b0fd-40f5-9a62-1c9bfe668938]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7, portal: 172.16.0.220,3260]
Aug 16 09:34:50 user nova-compute[73208]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7, portal: 172.16.0.220,3260] successful.
Aug 16 09:34:50 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5176b704-6223-44d3-9ef9-78d7458b0fa7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9fd2d9-82b8-456e-bcab-1edac69b27f2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] <== disconnect_volume: return (296ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:34:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Deleting instance files /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76_del
Aug 16 09:34:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Deletion of /opt/stack/data/nova/instances/6b259ec1-e74b-4255-aedf-685818f23c76_del complete
Aug 16 09:34:50 user nova-compute[73208]: INFO nova.compute.manager [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 16 09:34:50 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:34:50 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:34:51 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178476.282877, 8a9c86f4-584f-4907-bd7f-ba28fcc686d4 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:34:51 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] VM Stopped (Lifecycle Event)
Aug 16 09:34:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3d59282e-9ffb-4027-a7ad-31bcfa5a5244 None None] [instance: 8a9c86f4-584f-4907-bd7f-ba28fcc686d4] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:34:51 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:34:51 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Took 0.60 seconds to deallocate network for instance.
Aug 16 09:34:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-55e68a39-c55d-437e-a81e-b7a35d227f5d req-5f02ed47-e18d-446b-8501-907614af5ba0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55e68a39-c55d-437e-a81e-b7a35d227f5d req-5f02ed47-e18d-446b-8501-907614af5ba0 service nova] Acquiring lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55e68a39-c55d-437e-a81e-b7a35d227f5d req-5f02ed47-e18d-446b-8501-907614af5ba0 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-55e68a39-c55d-437e-a81e-b7a35d227f5d req-5f02ed47-e18d-446b-8501-907614af5ba0 service nova] Lock "6b259ec1-e74b-4255-aedf-685818f23c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-55e68a39-c55d-437e-a81e-b7a35d227f5d req-5f02ed47-e18d-446b-8501-907614af5ba0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] No waiting events found dispatching network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:34:52 user nova-compute[73208]: WARNING nova.compute.manager [req-55e68a39-c55d-437e-a81e-b7a35d227f5d req-5f02ed47-e18d-446b-8501-907614af5ba0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received unexpected event network-vif-plugged-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 for instance with vm_state active and task_state deleting.
Aug 16 09:34:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-55e68a39-c55d-437e-a81e-b7a35d227f5d req-5f02ed47-e18d-446b-8501-907614af5ba0 service nova] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Received event network-vif-deleted-94c240e8-e39e-4f10-ba85-8d3e4126a2a4 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-07bc712a-01e8-491e-b530-5dabf9a294c8 req-bf44b3df-37bc-4dbf-9354-4e170227f450 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-07bc712a-01e8-491e-b530-5dabf9a294c8 req-bf44b3df-37bc-4dbf-9354-4e170227f450 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing instance network info cache due to event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:34:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07bc712a-01e8-491e-b530-5dabf9a294c8 req-bf44b3df-37bc-4dbf-9354-4e170227f450 service nova] Acquiring lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:34:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07bc712a-01e8-491e-b530-5dabf9a294c8 req-bf44b3df-37bc-4dbf-9354-4e170227f450 service nova] Acquired lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:34:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-07bc712a-01e8-491e-b530-5dabf9a294c8 req-bf44b3df-37bc-4dbf-9354-4e170227f450 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:34:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-07bc712a-01e8-491e-b530-5dabf9a294c8 req-bf44b3df-37bc-4dbf-9354-4e170227f450 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updated VIF entry in instance network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:34:54 user nova-compute[73208]: DEBUG nova.network.neutron [req-07bc712a-01e8-491e-b530-5dabf9a294c8 req-bf44b3df-37bc-4dbf-9354-4e170227f450 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:34:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-07bc712a-01e8-491e-b530-5dabf9a294c8 req-bf44b3df-37bc-4dbf-9354-4e170227f450 service nova] Releasing lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:34:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:55 user nova-compute[73208]: INFO nova.compute.manager [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Took 4.14 seconds to detach 1 volumes for instance.
Aug 16 09:34:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:34:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:34:55 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:34:55 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:34:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:56 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Deleted allocations for instance 6b259ec1-e74b-4255-aedf-685818f23c76
Aug 16 09:34:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a597cc9c-af75-4b85-b43a-591f334cc5f6 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "6b259ec1-e74b-4255-aedf-685818f23c76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.390s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-dceb72a6-4907-4525-b7b1-09f6ebba8ace req-29b06ceb-ba06-4d1d-bf6e-99375999fec9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-dceb72a6-4907-4525-b7b1-09f6ebba8ace req-29b06ceb-ba06-4d1d-bf6e-99375999fec9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing instance network info cache due to event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dceb72a6-4907-4525-b7b1-09f6ebba8ace req-29b06ceb-ba06-4d1d-bf6e-99375999fec9 service nova] Acquiring lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dceb72a6-4907-4525-b7b1-09f6ebba8ace req-29b06ceb-ba06-4d1d-bf6e-99375999fec9 service nova] Acquired lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-dceb72a6-4907-4525-b7b1-09f6ebba8ace req-29b06ceb-ba06-4d1d-bf6e-99375999fec9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-dceb72a6-4907-4525-b7b1-09f6ebba8ace req-29b06ceb-ba06-4d1d-bf6e-99375999fec9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updated VIF entry in instance network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-dceb72a6-4907-4525-b7b1-09f6ebba8ace req-29b06ceb-ba06-4d1d-bf6e-99375999fec9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:34:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dceb72a6-4907-4525-b7b1-09f6ebba8ace req-29b06ceb-ba06-4d1d-bf6e-99375999fec9 service nova] Releasing lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:35:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:02 user nova-compute[73208]: INFO nova.compute.manager [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Rebooting instance
Aug 16 09:35:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:35:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquired lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:35:02 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG nova.network.neutron [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Releasing lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-5c426a84-ae32-45dc-a4ed-5349c46848eb req-0fb272a9-6b35-4351-a77f-e12de78039f7 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-unplugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5c426a84-ae32-45dc-a4ed-5349c46848eb req-0fb272a9-6b35-4351-a77f-e12de78039f7 service nova] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5c426a84-ae32-45dc-a4ed-5349c46848eb req-0fb272a9-6b35-4351-a77f-e12de78039f7 service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5c426a84-ae32-45dc-a4ed-5349c46848eb req-0fb272a9-6b35-4351-a77f-e12de78039f7 service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG nova.compute.manager [req-5c426a84-ae32-45dc-a4ed-5349c46848eb req-0fb272a9-6b35-4351-a77f-e12de78039f7 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] No waiting events found dispatching network-vif-unplugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:35:03 user nova-compute[73208]: WARNING nova.compute.manager [req-5c426a84-ae32-45dc-a4ed-5349c46848eb req-0fb272a9-6b35-4351-a77f-e12de78039f7 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received unexpected event network-vif-unplugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b for instance with vm_state active and task_state reboot_started_hard.
Aug 16 09:35:03 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance destroyed successfully.
Aug 16 09:35:03 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'resources' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-370990005',display_name='tempest-TestMinimumBasicScenario-server-370990005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-370990005',id=42,image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/bvUoe0c9XW9H9zrOQ9LVKbFwIs3jKg/hacX9jbr6f4jH59qxjDPnjAV8HrD3HO6MnF+Yu8Ef+hYeYULT8BU79HFKR08unvstxJ2VDdAFdxipNeZJsLP0XTmeSHKRUrA==',key_name='tempest-TestMinimumBasicScenario-1073759525',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-mfy04f1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:35:03Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=42f666e9-8880-42ac-9645-bf25038ca521,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG os_vif [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ed116d6-1c, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:04 user nova-compute[73208]: INFO os_vif [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c')
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFfDKOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:35:04 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9a8d8c-89cb-4904-b0ea-25156a9f5c97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[43943182-c3f1-4a8f-a5a2-5a79507efd09]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d02879a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[70692aac-f005-44df-970d-e1a9275fcafc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d02b57f-4766-4720-95fb-542f764330a6]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e80a76-08d8-47b9-badf-b093106ffcd9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4db52ec-de1b-4bed-aaf1-16708996ec06]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2610cd-2356-4d68-a7a6-80458c837b14]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f4e2e-51f8-4578-963e-31860af26428]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260]
Aug 16 09:35:04 user nova-compute[73208]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260] successful.
Aug 16 09:35:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b05dfa-b5c9-48df-b2af-fe0bc3ff08f3]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] <== disconnect_volume: return (263ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Start _get_guest_xml network_info=[{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6b3f0c68-f252-4874-8dba-0fdc99519093,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '6b3f0c68-f252-4874-8dba-0fdc99519093'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '72037d0a-3813-40cf-b6f5-1e20ea5d7e10', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFfDKOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '42f666e9-8880-42ac-9645-bf25038ca521', 'attached_at': '', 'detached_at': '', 'volume_id': '70c838e4-7977-495d-97fb-d3f6e05f7f8f', 'serial': '70c838e4-7977-495d-97fb-d3f6e05f7f8f'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:35:04 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:35:04 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6b3f0c68-f252-4874-8dba-0fdc99519093,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFfDKOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:35:04 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:35:04 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:35:04 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fc75fd-e47f-4fad-b28f-f25d4c8d89b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:35:04 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e2b11e-218a-4ab9-9f70-b1c5d31dd397]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f] added
Aug 16 09:35:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2744dba-05f0-4746-b3de-19b495fb71e8]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba6c03b-0210-42ed-a31c-51b11cdb1be2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlFfDKOC {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlFfDKOC" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[763789fd-d844-43e1-af95-8ea5cbe8e86f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlFfDKOC'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[413bb8b5-881f-44ca-8972-1164e3ef4588]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e7c322-3d67-494b-947e-2d3698e1a3c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:35:04 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:35:04 user nova-compute[73208]:  {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:35:04 user nova-compute[73208]: WARNING os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 09:35:04 user nova-compute[73208]: 
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[36630fa7-20c9-4c23-8e1d-686b604bf139]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260]
Aug 16 09:35:04 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260] successful.
Aug 16 09:35:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff8534c-d7af-486e-83c7-d37691a1a658]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d28b5c8-283c-4121-8f0a-9f003472d3f3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:04 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a02444-96cf-44ce-855d-02b58e824dc3]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:35:04 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFfDKOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178490.5022712, 6b259ec1-e74b-4255-aedf-685818f23c76 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:35:05 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] VM Stopped (Lifecycle Event)
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c24ecbc0-a65c-492f-ada4-22fbfc039999 None None] [instance: 6b259ec1-e74b-4255-aedf-685818f23c76] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-a39fb33c-502d-435f-9e7a-a4b925de9ae8 req-2598223b-ea4c-472a-bc37-4cbacbdc03bc service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a39fb33c-502d-435f-9e7a-a4b925de9ae8 req-2598223b-ea4c-472a-bc37-4cbacbdc03bc service nova] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a39fb33c-502d-435f-9e7a-a4b925de9ae8 req-2598223b-ea4c-472a-bc37-4cbacbdc03bc service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a39fb33c-502d-435f-9e7a-a4b925de9ae8 req-2598223b-ea4c-472a-bc37-4cbacbdc03bc service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.compute.manager [req-a39fb33c-502d-435f-9e7a-a4b925de9ae8 req-2598223b-ea4c-472a-bc37-4cbacbdc03bc service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] No waiting events found dispatching network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:35:05 user nova-compute[73208]: WARNING nova.compute.manager [req-a39fb33c-502d-435f-9e7a-a4b925de9ae8 req-2598223b-ea4c-472a-bc37-4cbacbdc03bc service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received unexpected event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b for instance with vm_state active and task_state reboot_started_hard.
Aug 16 09:35:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23964353634386236', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964353634386236', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-370990005',display_name='tempest-TestMinimumBasicScenario-server-370990005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-370990005',id=42,image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/bvUoe0c9XW9H9zrOQ9LVKbFwIs3jKg/hacX9jbr6f4jH59qxjDPnjAV8HrD3HO6MnF+Yu8Ef+hYeYULT8BU79HFKR08unvstxJ2VDdAFdxipNeZJsLP0XTmeSHKRUrA==',key_name='tempest-TestMinimumBasicScenario-1073759525',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-mfy04f1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:35:03Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=42f666e9-8880-42ac-9645-bf25038ca521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'pci_devices' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:35:05 user nova-compute[73208]:   <uuid>42f666e9-8880-42ac-9645-bf25038ca521</uuid>
Aug 16 09:35:05 user nova-compute[73208]:   <name>instance-0000002a</name>
Aug 16 09:35:05 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:35:05 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:35:05 user nova-compute[73208]:   <metadata>
Aug 16 09:35:05 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:35:05 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:35:05 user nova-compute[73208]:       <nova:name>tempest-TestMinimumBasicScenario-server-370990005</nova:name>
Aug 16 09:35:05 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:35:04</nova:creationTime>
Aug 16 09:35:05 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:35:05 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:35:05 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:35:05 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:35:05 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:35:05 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:35:05 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:35:05 user nova-compute[73208]:       <nova:owner>
Aug 16 09:35:05 user nova-compute[73208]:         <nova:user uuid="8c8d33aff1c142f0b93dbfe203ca040f">tempest-TestMinimumBasicScenario-1791382392-project-member</nova:user>
Aug 16 09:35:05 user nova-compute[73208]:         <nova:project uuid="3b0176f0acf145c799a0ec1fbdc2fef7">tempest-TestMinimumBasicScenario-1791382392</nova:project>
Aug 16 09:35:05 user nova-compute[73208]:       </nova:owner>
Aug 16 09:35:05 user nova-compute[73208]:       <nova:root type="image" uuid="6b3f0c68-f252-4874-8dba-0fdc99519093"/>
Aug 16 09:35:05 user nova-compute[73208]:       <nova:ports>
Aug 16 09:35:05 user nova-compute[73208]:         <nova:port uuid="4ed116d6-1cd7-4da5-b739-9c9f26a0b80b">
Aug 16 09:35:05 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:35:05 user nova-compute[73208]:         </nova:port>
Aug 16 09:35:05 user nova-compute[73208]:       </nova:ports>
Aug 16 09:35:05 user nova-compute[73208]:     </nova:instance>
Aug 16 09:35:05 user nova-compute[73208]:   </metadata>
Aug 16 09:35:05 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:35:05 user nova-compute[73208]:     <system>
Aug 16 09:35:05 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:35:05 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:35:05 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:35:05 user nova-compute[73208]:       <entry name="serial">42f666e9-8880-42ac-9645-bf25038ca521</entry>
Aug 16 09:35:05 user nova-compute[73208]:       <entry name="uuid">42f666e9-8880-42ac-9645-bf25038ca521</entry>
Aug 16 09:35:05 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:35:05 user nova-compute[73208]:     </system>
Aug 16 09:35:05 user nova-compute[73208]:   </sysinfo>
Aug 16 09:35:05 user nova-compute[73208]:   <os>
Aug 16 09:35:05 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:35:05 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:35:05 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:35:05 user nova-compute[73208]:   </os>
Aug 16 09:35:05 user nova-compute[73208]:   <features>
Aug 16 09:35:05 user nova-compute[73208]:     <acpi/>
Aug 16 09:35:05 user nova-compute[73208]:     <apic/>
Aug 16 09:35:05 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:35:05 user nova-compute[73208]:   </features>
Aug 16 09:35:05 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:35:05 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:35:05 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:35:05 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:35:05 user nova-compute[73208]:   </clock>
Aug 16 09:35:05 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:35:05 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:35:05 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:35:05 user nova-compute[73208]:   </cpu>
Aug 16 09:35:05 user nova-compute[73208]:   <devices>
Aug 16 09:35:05 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:35:05 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:35:05 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk"/>
Aug 16 09:35:05 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:35:05 user nova-compute[73208]:     </disk>
Aug 16 09:35:05 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:35:05 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:35:05 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:35:05 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:35:05 user nova-compute[73208]:       <serial>70c838e4-7977-495d-97fb-d3f6e05f7f8f</serial>
Aug 16 09:35:05 user nova-compute[73208]:     </disk>
Aug 16 09:35:05 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:35:05 user nova-compute[73208]:       <mac address="fa:16:3e:fc:19:56"/>
Aug 16 09:35:05 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:35:05 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:35:05 user nova-compute[73208]:       <target dev="tap4ed116d6-1c"/>
Aug 16 09:35:05 user nova-compute[73208]:     </interface>
Aug 16 09:35:05 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:35:05 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/console.log" append="off"/>
Aug 16 09:35:05 user nova-compute[73208]:     </serial>
Aug 16 09:35:05 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:35:05 user nova-compute[73208]:     <video>
Aug 16 09:35:05 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:35:05 user nova-compute[73208]:     </video>
Aug 16 09:35:05 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:35:05 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:35:05 user nova-compute[73208]:     </rng>
Aug 16 09:35:05 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:35:05 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:35:05 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:35:05 user nova-compute[73208]:     </memballoon>
Aug 16 09:35:05 user nova-compute[73208]:   </devices>
Aug 16 09:35:05 user nova-compute[73208]: </domain>
Aug 16 09:35:05 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Cannot resize image /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'migration_context' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-370990005',display_name='tempest-TestMinimumBasicScenario-server-370990005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-370990005',id=42,image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/bvUoe0c9XW9H9zrOQ9LVKbFwIs3jKg/hacX9jbr6f4jH59qxjDPnjAV8HrD3HO6MnF+Yu8Ef+hYeYULT8BU79HFKR08unvstxJ2VDdAFdxipNeZJsLP0XTmeSHKRUrA==',key_name='tempest-TestMinimumBasicScenario-1073759525',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-mfy04f1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:35:03Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=42f666e9-8880-42ac-9645-bf25038ca521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG os_vif [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ed116d6-1c, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ed116d6-1c, col_values=(('external_ids', {'iface-id': '4ed116d6-1cd7-4da5-b739-9c9f26a0b80b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:19:56', 'vm-uuid': '42f666e9-8880-42ac-9645-bf25038ca521'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:35:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:06 user nova-compute[73208]: INFO os_vif [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c')
Aug 16 09:35:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:07 user nova-compute[73208]: DEBUG nova.compute.manager [req-a888aa80-4c8b-4be6-b392-84bc3139df20 req-60767dba-da4b-4ca4-a7a1-762cc50e32ce service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:35:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a888aa80-4c8b-4be6-b392-84bc3139df20 req-60767dba-da4b-4ca4-a7a1-762cc50e32ce service nova] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a888aa80-4c8b-4be6-b392-84bc3139df20 req-60767dba-da4b-4ca4-a7a1-762cc50e32ce service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a888aa80-4c8b-4be6-b392-84bc3139df20 req-60767dba-da4b-4ca4-a7a1-762cc50e32ce service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:07 user nova-compute[73208]: DEBUG nova.compute.manager [req-a888aa80-4c8b-4be6-b392-84bc3139df20 req-60767dba-da4b-4ca4-a7a1-762cc50e32ce service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] No waiting events found dispatching network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:35:07 user nova-compute[73208]: WARNING nova.compute.manager [req-a888aa80-4c8b-4be6-b392-84bc3139df20 req-60767dba-da4b-4ca4-a7a1-762cc50e32ce service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received unexpected event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b for instance with vm_state active and task_state reboot_started_hard.
Aug 16 09:35:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for 42f666e9-8880-42ac-9645-bf25038ca521 due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:35:09 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178509.9695792, 42f666e9-8880-42ac-9645-bf25038ca521 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:35:09 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] VM Resumed (Lifecycle Event)
Aug 16 09:35:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:35:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance rebooted successfully.
Aug 16 09:35:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:35:09 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:35:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:35:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-80ee4778-55be-4f4a-b26d-a3eaa1e72245 req-0d6b9b3c-d298-4599-b565-eb6c7d1feff3 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:35:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80ee4778-55be-4f4a-b26d-a3eaa1e72245 req-0d6b9b3c-d298-4599-b565-eb6c7d1feff3 service nova] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80ee4778-55be-4f4a-b26d-a3eaa1e72245 req-0d6b9b3c-d298-4599-b565-eb6c7d1feff3 service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-80ee4778-55be-4f4a-b26d-a3eaa1e72245 req-0d6b9b3c-d298-4599-b565-eb6c7d1feff3 service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-80ee4778-55be-4f4a-b26d-a3eaa1e72245 req-0d6b9b3c-d298-4599-b565-eb6c7d1feff3 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] No waiting events found dispatching network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:35:10 user nova-compute[73208]: WARNING nova.compute.manager [req-80ee4778-55be-4f4a-b26d-a3eaa1e72245 req-0d6b9b3c-d298-4599-b565-eb6c7d1feff3 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received unexpected event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b for instance with vm_state active and task_state reboot_started_hard.
Aug 16 09:35:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 09:35:10 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178509.969902, 42f666e9-8880-42ac-9645-bf25038ca521 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:35:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] VM Started (Lifecycle Event)
Aug 16 09:35:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:35:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8c5953d0-3f62-4119-a8ff-a0db1c08db58 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.595s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:35:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG nova.objects.instance [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:25 user nova-compute[73208]: INFO nova.compute.manager [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attaching volume aa1cc228-592f-4722-9021-f74d22e2bdb4 to /dev/vdb
Aug 16 09:35:25 user nova-compute[73208]: DEBUG os_brick.utils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdf6637-e8b3-4748-8459-22ee8bf18c47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[58106827-eba0-4b91-916b-1df117575d0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5ab5d8-90f8-49f6-8c47-a333bf499e54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1ecf3f-0580-4514-85ed-4ab862de8ade]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:35:26 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:35:26 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba76d8-17ba-4f3f-b853-d0f5b4b33751]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG os_brick.utils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating existing volume attachment record: 4d5f22e3-b171-4822-bcd0-017ea2bdd465 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:32 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:32 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:35:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:34 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:35:34 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8335MB free_disk=25.16818618774414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f5067d00-0cd2-40f2-875f-577760762123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 42f666e9-8880-42ac-9645-bf25038ca521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:35:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YJOHCZGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:35:36 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:35:36 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:35:36 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[af59fb24-ade7-4715-ac75-da6f12c3b34c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:35:36 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82db76d-2c13-4013-b08c-331ac5686ab6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4] added
Aug 16 09:35:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad493b4-9747-4dda-97d7-ade008471953]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd0dd37-87fc-4646-9ad9-9923581b4426]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YJOHCZGP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YJOHCZGP" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb658af7-80f5-4286-a2ca-e455866f77e1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YJOHCZGP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d086b93d-6550-459f-9cc7-020a2b9828b7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6da82a-b487-498d-8621-a08f9b061d60]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9fc1bf-eceb-4668-8d2c-2d6a93bfbcf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4, portal: 172.16.0.220,3260]
Aug 16 09:35:36 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4, portal: 172.16.0.220,3260] successful.
Aug 16 09:35:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e89e61-7956-48ee-88b4-efdeedfd251e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0242a1-c36e-41e0-981b-f55768b72ecd]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:36 user nova-compute[73208]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 (non-flash)
Aug 16 09:35:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:36 user nova-compute[73208]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 (non-flash)
Aug 16 09:35:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a799a494-0ecf-43c6-be28-6d7069f3206e]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YJOHCZGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:35:36 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:35:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23865643736373537', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:35:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865643736373537', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:35:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:35:37 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:35:37 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:35:37 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:35:37 user nova-compute[73208]:   <serial>aa1cc228-592f-4722-9021-f74d22e2bdb4</serial>
Aug 16 09:35:37 user nova-compute[73208]: </disk>
Aug 16 09:35:37 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:35:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:35:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:35:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No VIF found with MAC fa:16:3e:0e:b5:ea, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:35:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cca1d8b8-28c6-49f8-9fda-a81c0934f860 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.573s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:38 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:35:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:40 user nova-compute[73208]: INFO nova.compute.manager [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Terminating instance
Aug 16 09:35:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:40 user nova-compute[73208]: INFO nova.compute.manager [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Detaching volume aa1cc228-592f-4722-9021-f74d22e2bdb4
Aug 16 09:35:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:40 user nova-compute[73208]: INFO nova.virt.block_device [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attempting to driver detach volume aa1cc228-592f-4722-9021-f74d22e2bdb4 from mountpoint /dev/vdb
Aug 16 09:35:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Attempting to detach device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:35:40 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:35:40 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:35:40 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:35:40 user nova-compute[73208]:   <serial>aa1cc228-592f-4722-9021-f74d22e2bdb4</serial>
Aug 16 09:35:40 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:35:40 user nova-compute[73208]: </disk>
Aug 16 09:35:40 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:35:40 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully detached device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the persistent domain config.
Aug 16 09:35:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5067d00-0cd2-40f2-875f-577760762123 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:35:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:35:40 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:35:40 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:35:40 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:35:40 user nova-compute[73208]:   <serial>aa1cc228-592f-4722-9021-f74d22e2bdb4</serial>
Aug 16 09:35:40 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:35:40 user nova-compute[73208]: </disk>
Aug 16 09:35:40 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-e1cd3959-0ec2-47e7-ba6d-ea1f2cc5efc5 req-25b1b3d6-bb10-41f7-92e8-d25f5f42d126 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received event network-vif-unplugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e1cd3959-0ec2-47e7-ba6d-ea1f2cc5efc5 req-25b1b3d6-bb10-41f7-92e8-d25f5f42d126 service nova] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e1cd3959-0ec2-47e7-ba6d-ea1f2cc5efc5 req-25b1b3d6-bb10-41f7-92e8-d25f5f42d126 service nova] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e1cd3959-0ec2-47e7-ba6d-ea1f2cc5efc5 req-25b1b3d6-bb10-41f7-92e8-d25f5f42d126 service nova] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-e1cd3959-0ec2-47e7-ba6d-ea1f2cc5efc5 req-25b1b3d6-bb10-41f7-92e8-d25f5f42d126 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] No waiting events found dispatching network-vif-unplugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.compute.manager [req-e1cd3959-0ec2-47e7-ba6d-ea1f2cc5efc5 req-25b1b3d6-bb10-41f7-92e8-d25f5f42d126 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received event network-vif-unplugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178541.42883, f5067d00-0cd2-40f2-875f-577760762123 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:35:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully detached device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the live domain config.
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YJOHCZGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:35:41 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[55de7201-4ee9-49b2-893f-ba09f8a3cdb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64b075a-c60e-4473-9ca8-8d2938618c6b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:41 user nova-compute[73208]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 (non-flash)
Aug 16 09:35:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:35:41 user nova-compute[73208]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 (non-flash)
Aug 16 09:35:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d027e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541d064-105a-4b3b-958d-f5d64c94c570]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.080s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b711ca-8538-40d8-8d14-04fff2b903e4]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[758c06b0-e05f-4ee2-830a-09736b09b369]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2417d749-8b1e-49bd-9ee5-6eb7c1fb07d1]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b178522e-5be3-4999-8f81-6f812f03ed25]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:35:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Instance destroyed successfully.
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lazy-loading 'resources' on Instance uuid e23ec51a-a5cb-451b-91aa-f2b241d2b0cd {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f9a54d-5a5e-426d-8413-1b8e3dfc1071]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4, portal: 172.16.0.220,3260]
Aug 16 09:35:41 user nova-compute[73208]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4, portal: 172.16.0.220,3260] successful.
Aug 16 09:35:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1736574535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1736574535',id=19,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:16:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5da0d7fd51c4dcaba48f74dc423e684',ramdisk_id='',reservation_id='r-5eocl155',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:17:59Z,user_data=None,user_id='91255b4dbf814537906275122738afcf',uuid=e23ec51a-a5cb-451b-91aa-f2b241d2b0cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converting VIF {"id": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "address": "fa:16:3e:02:8b:32", "network": {"id": "d785defd-7ca9-4226-b56d-117402957896", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-488924901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5da0d7fd51c4dcaba48f74dc423e684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428f4c85-b3", "ovs_interfaceid": "428f4c85-b3f2-4f3b-b242-8450a4e0cd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=428f4c85-b3f2-4f3b-b242-8450a4e0cd8d,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428f4c85-b3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_vif [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=428f4c85-b3f2-4f3b-b242-8450a4e0cd8d,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428f4c85-b3') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa1cc228-592f-4722-9021-f74d22e2bdb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c65c66b-c013-49ca-848d-3130171de33b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap428f4c85-b3, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== disconnect_volume: return (396ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:35:41 user nova-compute[73208]: INFO os_vif [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=428f4c85-b3f2-4f3b-b242-8450a4e0cd8d,network=Network(d785defd-7ca9-4226-b56d-117402957896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428f4c85-b3')
Aug 16 09:35:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Deleting instance files /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd_del
Aug 16 09:35:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Deletion of /opt/stack/data/nova/instances/e23ec51a-a5cb-451b-91aa-f2b241d2b0cd_del complete
Aug 16 09:35:41 user nova-compute[73208]: INFO nova.compute.manager [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 16 09:35:41 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:35:41 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:35:42 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Took 0.63 seconds to deallocate network for instance.
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-4955fee1-76d1-4c14-bdf7-7ec32be34d4a req-ca9878f3-5c37-46d3-9c11-aabea9fc2806 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received event network-vif-deleted-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:35:42 user nova-compute[73208]: INFO nova.compute.manager [req-4955fee1-76d1-4c14-bdf7-7ec32be34d4a req-ca9878f3-5c37-46d3-9c11-aabea9fc2806 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Neutron deleted interface 428f4c85-b3f2-4f3b-b242-8450a4e0cd8d; detaching it from the instance and deleting it from the info cache
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.network.neutron [req-4955fee1-76d1-4c14-bdf7-7ec32be34d4a req-ca9878f3-5c37-46d3-9c11-aabea9fc2806 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-4955fee1-76d1-4c14-bdf7-7ec32be34d4a req-ca9878f3-5c37-46d3-9c11-aabea9fc2806 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Detach interface failed, port_id=428f4c85-b3f2-4f3b-b242-8450a4e0cd8d, reason: Instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.objects.instance [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-536c6b56-f6d6-4d62-9bf6-00b327014bbf tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.953s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating instance_info_cache with network_info: [{"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:35:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:42 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Deleted allocations for instance e23ec51a-a5cb-451b-91aa-f2b241d2b0cd
Aug 16 09:35:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b977c29d-9119-49f0-956e-0cec9cbd4750 tempest-ServerBootFromVolumeStableRescueTest-1980932529 tempest-ServerBootFromVolumeStableRescueTest-1980932529-project-member] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-f5ec2d65-1cb3-4416-98dc-b6cc3d19fc1b req-8a1ace16-45b1-4c82-afa9-5f9693e240c2 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received event network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:35:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5ec2d65-1cb3-4416-98dc-b6cc3d19fc1b req-8a1ace16-45b1-4c82-afa9-5f9693e240c2 service nova] Acquiring lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:35:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5ec2d65-1cb3-4416-98dc-b6cc3d19fc1b req-8a1ace16-45b1-4c82-afa9-5f9693e240c2 service nova] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:35:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5ec2d65-1cb3-4416-98dc-b6cc3d19fc1b req-8a1ace16-45b1-4c82-afa9-5f9693e240c2 service nova] Lock "e23ec51a-a5cb-451b-91aa-f2b241d2b0cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:35:43 user nova-compute[73208]: DEBUG nova.compute.manager [req-f5ec2d65-1cb3-4416-98dc-b6cc3d19fc1b req-8a1ace16-45b1-4c82-afa9-5f9693e240c2 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] No waiting events found dispatching network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:35:43 user nova-compute[73208]: WARNING nova.compute.manager [req-f5ec2d65-1cb3-4416-98dc-b6cc3d19fc1b req-8a1ace16-45b1-4c82-afa9-5f9693e240c2 service nova] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Received unexpected event network-vif-plugged-428f4c85-b3f2-4f3b-b242-8450a4e0cd8d for instance with vm_state deleted and task_state None.
Aug 16 09:35:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:35:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:35:56 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178541.8008, e23ec51a-a5cb-451b-91aa-f2b241d2b0cd => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:35:56 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] VM Stopped (Lifecycle Event)
Aug 16 09:35:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7143d8ba-edd2-4ca0-839e-59ad2a70d169 None None] [instance: e23ec51a-a5cb-451b-91aa-f2b241d2b0cd] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:35:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:36:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:36:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:33 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:36:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:36:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:35 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:36:35 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=25.281051635742188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.objects.instance [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f5067d00-0cd2-40f2-875f-577760762123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 42f666e9-8880-42ac-9645-bf25038ca521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:35 user nova-compute[73208]: INFO nova.compute.manager [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attaching volume 83c4750d-314f-4290-87ad-440e2b1553da to /dev/vdb
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG os_brick.utils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96e28e5-11d7-46cd-80c2-c469f46d480b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd9cfa-d822-427c-81de-dc34c01d6898]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5da84d4-d46b-4ed2-90fa-069bdc522331]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe1892c-0cf1-4392-82eb-33e713425012]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:36:35 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:36:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaac39f-fa02-4ea0-aa78-6342f5b382a1]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG os_brick.utils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== get_connector_properties: return (439ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:36:35 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating existing volume attachment record: 74bbb56b-6f85-4881-9d92-9cbf9f44c051 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:36:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:37 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:36:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:36:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:36:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:36:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:36:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:36:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:36:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:36:43 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:36:46 user nova-compute[73208]: INFO nova.compute.claims [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Claim successful on node user
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:36:46 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.policy [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1fe7fe8c35c42aeaf87cf3c4d4a37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e197c75147746a282a02c61bba8ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:36:46 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Creating image(s)
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk 1073741824" returned: 0 in 0.061s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9dd3d75b-db07-4907-854c-42278f817bb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTCwUnjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:36:47 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:36:47 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:36:47 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7ea15a-ecb7-4886-b385-6c4568b1d49f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:36:47 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:36:47 user nova-compute[73208]: INFO nova.compute.claims [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Claim successful on node user
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e972b-32e8-4cd6-8a09-a674ef6bb2fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da] added
Aug 16 09:36:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac39b61-1205-4094-9261-44a4173e306c]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.240s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[425dd08d-34b2-49b2-afe0-a19134bc8b0b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uTCwUnjQ {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uTCwUnjQ" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eb4066-a650-4114-8244-4414d7fd9de6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uTCwUnjQ'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[318e1da4-3fcb-4ab2-a6e3-34a1d6e2154e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Successfully created port: 99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cc976a-b9ce-45e5-9c1d-f13568e6bc44]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:36:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:36:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9546751c-6c89-4187-8c33-1c57e0da9ea9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da, portal: 172.16.0.220,3260]
Aug 16 09:36:47 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da, portal: 172.16.0.220,3260] successful.
Aug 16 09:36:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Cannot resize image /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'migration_context' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7584fa-ec92-4f59-958b-3c903b3868ba]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Ensure instance console log exists: /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3011f60-7a36-482f-a83e-b1032fdd0b1b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:36:47 user nova-compute[73208]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da (non-flash)
Aug 16 09:36:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:36:47 user nova-compute[73208]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da (non-flash)
Aug 16 09:36:47 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[01244d16-4bcd-4bf8-829f-5426b349135f]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:36:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.policy [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1fe7fe8c35c42aeaf87cf3c4d4a37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e197c75147746a282a02c61bba8ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:36:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Creating image(s)
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.212s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Successfully updated port: 99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk 1073741824" returned: 0 in 0.061s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-a55b0fed-9633-487b-8d2d-14dda4de79db req-c60d96cb-629f-4c2d-b682-631bf5f17d21 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-changed-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-a55b0fed-9633-487b-8d2d-14dda4de79db req-c60d96cb-629f-4c2d-b682-631bf5f17d21 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Refreshing instance network info cache due to event network-changed-99199c52-a1ab-4001-b10e-51d2af388626. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a55b0fed-9633-487b-8d2d-14dda4de79db req-c60d96cb-629f-4c2d-b682-631bf5f17d21 service nova] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a55b0fed-9633-487b-8d2d-14dda4de79db req-c60d96cb-629f-4c2d-b682-631bf5f17d21 service nova] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-a55b0fed-9633-487b-8d2d-14dda4de79db req-c60d96cb-629f-4c2d-b682-631bf5f17d21 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Refreshing network info cache for port 99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Successfully created port: be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-a55b0fed-9633-487b-8d2d-14dda4de79db req-c60d96cb-629f-4c2d-b682-631bf5f17d21 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTCwUnjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23463393830333066', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463393830333066', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.objects.instance [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:36:48 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:36:48 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:36:48 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:36:48 user nova-compute[73208]:   <serial>83c4750d-314f-4290-87ad-440e2b1553da</serial>
Aug 16 09:36:48 user nova-compute[73208]: </disk>
Aug 16 09:36:48 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.network.neutron [req-a55b0fed-9633-487b-8d2d-14dda4de79db req-c60d96cb-629f-4c2d-b682-631bf5f17d21 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a55b0fed-9633-487b-8d2d-14dda4de79db req-c60d96cb-629f-4c2d-b682-631bf5f17d21 service nova] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Cannot resize image /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'migration_context' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Ensure instance console log exists: /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:36:48 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] No VIF found with MAC fa:16:3e:0e:b5:ea, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-59c5caef-4a8e-407e-bba4-d78693a322fc tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.803s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance network_info: |[{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Start _get_guest_xml network_info=[{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:36:49 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:36:49 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-176421415',display_name='tempest-ServerRescueNegativeTestJSON-server-176421415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-176421415',id=43,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-a019b11r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:36:46Z,user_data=None,user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=e54f2b10-5702-49c5-ab1a-da97d4a7ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=99199c52-a1ab-4001-b10e-51d2af388626,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99199c52-a1') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'pci_devices' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:36:49 user nova-compute[73208]:   <uuid>e54f2b10-5702-49c5-ab1a-da97d4a7ca05</uuid>
Aug 16 09:36:49 user nova-compute[73208]:   <name>instance-0000002b</name>
Aug 16 09:36:49 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:36:49 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:36:49 user nova-compute[73208]:   <metadata>
Aug 16 09:36:49 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:36:49 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-176421415</nova:name>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:36:49</nova:creationTime>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:36:49 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:36:49 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:owner>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:user uuid="a1fe7fe8c35c42aeaf87cf3c4d4a37d8">tempest-ServerRescueNegativeTestJSON-1153173897-project-member</nova:user>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:project uuid="9e197c75147746a282a02c61bba8ef65">tempest-ServerRescueNegativeTestJSON-1153173897</nova:project>
Aug 16 09:36:49 user nova-compute[73208]:       </nova:owner>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:ports>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:port uuid="99199c52-a1ab-4001-b10e-51d2af388626">
Aug 16 09:36:49 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:36:49 user nova-compute[73208]:         </nova:port>
Aug 16 09:36:49 user nova-compute[73208]:       </nova:ports>
Aug 16 09:36:49 user nova-compute[73208]:     </nova:instance>
Aug 16 09:36:49 user nova-compute[73208]:   </metadata>
Aug 16 09:36:49 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:36:49 user nova-compute[73208]:     <system>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="serial">e54f2b10-5702-49c5-ab1a-da97d4a7ca05</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="uuid">e54f2b10-5702-49c5-ab1a-da97d4a7ca05</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:36:49 user nova-compute[73208]:     </system>
Aug 16 09:36:49 user nova-compute[73208]:   </sysinfo>
Aug 16 09:36:49 user nova-compute[73208]:   <os>
Aug 16 09:36:49 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:36:49 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:36:49 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:36:49 user nova-compute[73208]:   </os>
Aug 16 09:36:49 user nova-compute[73208]:   <features>
Aug 16 09:36:49 user nova-compute[73208]:     <acpi/>
Aug 16 09:36:49 user nova-compute[73208]:     <apic/>
Aug 16 09:36:49 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:36:49 user nova-compute[73208]:   </features>
Aug 16 09:36:49 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:36:49 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:36:49 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:36:49 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:36:49 user nova-compute[73208]:   </clock>
Aug 16 09:36:49 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:36:49 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:36:49 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:36:49 user nova-compute[73208]:   </cpu>
Aug 16 09:36:49 user nova-compute[73208]:   <devices>
Aug 16 09:36:49 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:36:49 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:36:49 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk"/>
Aug 16 09:36:49 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:36:49 user nova-compute[73208]:     </disk>
Aug 16 09:36:49 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:36:49 user nova-compute[73208]:       <mac address="fa:16:3e:b2:4c:a3"/>
Aug 16 09:36:49 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:36:49 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:36:49 user nova-compute[73208]:       <target dev="tap99199c52-a1"/>
Aug 16 09:36:49 user nova-compute[73208]:     </interface>
Aug 16 09:36:49 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:36:49 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/console.log" append="off"/>
Aug 16 09:36:49 user nova-compute[73208]:     </serial>
Aug 16 09:36:49 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:36:49 user nova-compute[73208]:     <video>
Aug 16 09:36:49 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:36:49 user nova-compute[73208]:     </video>
Aug 16 09:36:49 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:36:49 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:36:49 user nova-compute[73208]:     </rng>
Aug 16 09:36:49 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:36:49 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:36:49 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:36:49 user nova-compute[73208]:     </memballoon>
Aug 16 09:36:49 user nova-compute[73208]:   </devices>
Aug 16 09:36:49 user nova-compute[73208]: </domain>
Aug 16 09:36:49 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-176421415',display_name='tempest-ServerRescueNegativeTestJSON-server-176421415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-176421415',id=43,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-a019b11r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:36:46Z,user_data=None,user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=e54f2b10-5702-49c5-ab1a-da97d4a7ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=99199c52-a1ab-4001-b10e-51d2af388626,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99199c52-a1') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG os_vif [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=99199c52-a1ab-4001-b10e-51d2af388626,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99199c52-a1') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99199c52-a1, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99199c52-a1, col_values=(('external_ids', {'iface-id': '99199c52-a1ab-4001-b10e-51d2af388626', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:4c:a3', 'vm-uuid': 'e54f2b10-5702-49c5-ab1a-da97d4a7ca05'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Successfully updated port: be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:49 user nova-compute[73208]: INFO os_vif [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=99199c52-a1ab-4001-b10e-51d2af388626,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99199c52-a1')
Aug 16 09:36:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquired lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-9920a0f5-6d32-4086-b770-9982c33be6b2 req-cf257ecc-3df6-4247-a7d9-3a66468f42cc service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-changed-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.compute.manager [req-9920a0f5-6d32-4086-b770-9982c33be6b2 req-cf257ecc-3df6-4247-a7d9-3a66468f42cc service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Refreshing instance network info cache due to event network-changed-be56fa8f-019f-4784-8ac5-52519e145898. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9920a0f5-6d32-4086-b770-9982c33be6b2 req-cf257ecc-3df6-4247-a7d9-3a66468f42cc service nova] Acquiring lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No VIF found with MAC fa:16:3e:b2:4c:a3, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Releasing lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Instance network_info: |[{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9920a0f5-6d32-4086-b770-9982c33be6b2 req-cf257ecc-3df6-4247-a7d9-3a66468f42cc service nova] Acquired lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-9920a0f5-6d32-4086-b770-9982c33be6b2 req-cf257ecc-3df6-4247-a7d9-3a66468f42cc service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Refreshing network info cache for port be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Start _get_guest_xml network_info=[{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:36:49 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:36:49 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-316213984',display_name='tempest-ServerRescueNegativeTestJSON-server-316213984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-316213984',id=44,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-9dwyltan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:36:48Z,user_data=None,user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=9dd3d75b-db07-4907-854c-42278f817bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6f:98,bridge_name='br-int',has_traffic_filtering=True,id=be56fa8f-019f-4784-8ac5-52519e145898,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe56fa8f-01') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:36:49 user nova-compute[73208]:   <uuid>9dd3d75b-db07-4907-854c-42278f817bb9</uuid>
Aug 16 09:36:49 user nova-compute[73208]:   <name>instance-0000002c</name>
Aug 16 09:36:49 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:36:49 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:36:49 user nova-compute[73208]:   <metadata>
Aug 16 09:36:49 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:36:49 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-316213984</nova:name>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:36:49</nova:creationTime>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:36:49 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:36:49 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:owner>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:user uuid="a1fe7fe8c35c42aeaf87cf3c4d4a37d8">tempest-ServerRescueNegativeTestJSON-1153173897-project-member</nova:user>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:project uuid="9e197c75147746a282a02c61bba8ef65">tempest-ServerRescueNegativeTestJSON-1153173897</nova:project>
Aug 16 09:36:49 user nova-compute[73208]:       </nova:owner>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:36:49 user nova-compute[73208]:       <nova:ports>
Aug 16 09:36:49 user nova-compute[73208]:         <nova:port uuid="be56fa8f-019f-4784-8ac5-52519e145898">
Aug 16 09:36:49 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 09:36:49 user nova-compute[73208]:         </nova:port>
Aug 16 09:36:49 user nova-compute[73208]:       </nova:ports>
Aug 16 09:36:49 user nova-compute[73208]:     </nova:instance>
Aug 16 09:36:49 user nova-compute[73208]:   </metadata>
Aug 16 09:36:49 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:36:49 user nova-compute[73208]:     <system>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="serial">9dd3d75b-db07-4907-854c-42278f817bb9</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="uuid">9dd3d75b-db07-4907-854c-42278f817bb9</entry>
Aug 16 09:36:49 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:36:49 user nova-compute[73208]:     </system>
Aug 16 09:36:49 user nova-compute[73208]:   </sysinfo>
Aug 16 09:36:49 user nova-compute[73208]:   <os>
Aug 16 09:36:49 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:36:49 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:36:49 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:36:49 user nova-compute[73208]:   </os>
Aug 16 09:36:49 user nova-compute[73208]:   <features>
Aug 16 09:36:49 user nova-compute[73208]:     <acpi/>
Aug 16 09:36:49 user nova-compute[73208]:     <apic/>
Aug 16 09:36:49 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:36:49 user nova-compute[73208]:   </features>
Aug 16 09:36:49 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:36:49 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:36:49 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:36:49 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:36:49 user nova-compute[73208]:   </clock>
Aug 16 09:36:49 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:36:49 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:36:49 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:36:49 user nova-compute[73208]:   </cpu>
Aug 16 09:36:49 user nova-compute[73208]:   <devices>
Aug 16 09:36:49 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:36:49 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:36:49 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk"/>
Aug 16 09:36:49 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:36:49 user nova-compute[73208]:     </disk>
Aug 16 09:36:49 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:36:49 user nova-compute[73208]:       <mac address="fa:16:3e:dc:6f:98"/>
Aug 16 09:36:49 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:36:49 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:36:49 user nova-compute[73208]:       <target dev="tapbe56fa8f-01"/>
Aug 16 09:36:49 user nova-compute[73208]:     </interface>
Aug 16 09:36:49 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:36:49 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/console.log" append="off"/>
Aug 16 09:36:49 user nova-compute[73208]:     </serial>
Aug 16 09:36:49 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:36:49 user nova-compute[73208]:     <video>
Aug 16 09:36:49 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:36:49 user nova-compute[73208]:     </video>
Aug 16 09:36:49 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:36:49 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:36:49 user nova-compute[73208]:     </rng>
Aug 16 09:36:49 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:36:49 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:36:49 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:36:49 user nova-compute[73208]:     </memballoon>
Aug 16 09:36:49 user nova-compute[73208]:   </devices>
Aug 16 09:36:49 user nova-compute[73208]: </domain>
Aug 16 09:36:49 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-316213984',display_name='tempest-ServerRescueNegativeTestJSON-server-316213984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-316213984',id=44,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-9dwyltan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:36:48Z,user_data=None,user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=9dd3d75b-db07-4907-854c-42278f817bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6f:98,bridge_name='br-int',has_traffic_filtering=True,id=be56fa8f-019f-4784-8ac5-52519e145898,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe56fa8f-01') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG os_vif [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6f:98,bridge_name='br-int',has_traffic_filtering=True,id=be56fa8f-019f-4784-8ac5-52519e145898,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe56fa8f-01') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe56fa8f-01, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe56fa8f-01, col_values=(('external_ids', {'iface-id': 'be56fa8f-019f-4784-8ac5-52519e145898', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:6f:98', 'vm-uuid': '9dd3d75b-db07-4907-854c-42278f817bb9'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:49 user nova-compute[73208]: INFO os_vif [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6f:98,bridge_name='br-int',has_traffic_filtering=True,id=be56fa8f-019f-4784-8ac5-52519e145898,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe56fa8f-01')
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:36:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No VIF found with MAC fa:16:3e:dc:6f:98, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:36:50 user nova-compute[73208]: DEBUG nova.network.neutron [req-9920a0f5-6d32-4086-b770-9982c33be6b2 req-cf257ecc-3df6-4247-a7d9-3a66468f42cc service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updated VIF entry in instance network info cache for port be56fa8f-019f-4784-8ac5-52519e145898. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:36:50 user nova-compute[73208]: DEBUG nova.network.neutron [req-9920a0f5-6d32-4086-b770-9982c33be6b2 req-cf257ecc-3df6-4247-a7d9-3a66468f42cc service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:36:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9920a0f5-6d32-4086-b770-9982c33be6b2 req-cf257ecc-3df6-4247-a7d9-3a66468f42cc service nova] Releasing lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:51 user nova-compute[73208]: INFO nova.compute.manager [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Detaching volume 83c4750d-314f-4290-87ad-440e2b1553da
Aug 16 09:36:51 user nova-compute[73208]: INFO nova.virt.block_device [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Attempting to driver detach volume 83c4750d-314f-4290-87ad-440e2b1553da from mountpoint /dev/vdb
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Attempting to detach device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:36:51 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:36:51 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:36:51 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:36:51 user nova-compute[73208]:   <serial>83c4750d-314f-4290-87ad-440e2b1553da</serial>
Aug 16 09:36:51 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:36:51 user nova-compute[73208]: </disk>
Aug 16 09:36:51 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:36:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully detached device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the persistent domain config.
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5067d00-0cd2-40f2-875f-577760762123 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:36:51 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:36:51 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:36:51 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:36:51 user nova-compute[73208]:   <serial>83c4750d-314f-4290-87ad-440e2b1553da</serial>
Aug 16 09:36:51 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:36:51 user nova-compute[73208]: </disk>
Aug 16 09:36:51 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-7af4ff73-5b9f-4835-a64f-798900c0a220 req-50f35842-9a88-417a-a6b8-fee0bc488aab service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7af4ff73-5b9f-4835-a64f-798900c0a220 req-50f35842-9a88-417a-a6b8-fee0bc488aab service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7af4ff73-5b9f-4835-a64f-798900c0a220 req-50f35842-9a88-417a-a6b8-fee0bc488aab service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7af4ff73-5b9f-4835-a64f-798900c0a220 req-50f35842-9a88-417a-a6b8-fee0bc488aab service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.compute.manager [req-7af4ff73-5b9f-4835-a64f-798900c0a220 req-50f35842-9a88-417a-a6b8-fee0bc488aab service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:36:51 user nova-compute[73208]: WARNING nova.compute.manager [req-7af4ff73-5b9f-4835-a64f-798900c0a220 req-50f35842-9a88-417a-a6b8-fee0bc488aab service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state building and task_state spawning.
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178611.9735715, f5067d00-0cd2-40f2-875f-577760762123 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:36:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully detached device vdb from instance f5067d00-0cd2-40f2-875f-577760762123 from the live domain config.
Aug 16 09:36:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTCwUnjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:36:51 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:36:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:36:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da073e6-79ea-4d24-affc-a9160619dbd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67c82e7-699c-40fa-bdba-2b231efc7dbc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:36:52 user nova-compute[73208]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da (non-flash)
Aug 16 09:36:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:36:52 user nova-compute[73208]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da (non-flash)
Aug 16 09:36:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d033e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf62245-999c-411c-8596-5191f8db6ff0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc74a924-0174-4e1a-adcd-f029a5c78cdb]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b540d300-d980-4926-83b2-377ea4442955]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7caa8d-ddc8-4573-841a-e230891f3b6a]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e068b-94a4-4a33-a7bb-58f5925f26c4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa674887-ea8c-476a-bf16-7e9a08c3bcc3]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da, portal: 172.16.0.220,3260]
Aug 16 09:36:52 user nova-compute[73208]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da, portal: 172.16.0.220,3260] successful.
Aug 16 09:36:52 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c4750d-314f-4290-87ad-440e2b1553da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a064856-b616-4c62-b080-09340a387801]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] <== disconnect_volume: return (320ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-1e3609d1-ba78-4212-822f-83bc8f8a79de req-48d39df8-b1d9-406d-a8ee-5063768b748a service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:36:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e3609d1-ba78-4212-822f-83bc8f8a79de req-48d39df8-b1d9-406d-a8ee-5063768b748a service nova] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e3609d1-ba78-4212-822f-83bc8f8a79de req-48d39df8-b1d9-406d-a8ee-5063768b748a service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e3609d1-ba78-4212-822f-83bc8f8a79de req-48d39df8-b1d9-406d-a8ee-5063768b748a service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:53 user nova-compute[73208]: DEBUG nova.compute.manager [req-1e3609d1-ba78-4212-822f-83bc8f8a79de req-48d39df8-b1d9-406d-a8ee-5063768b748a service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] No waiting events found dispatching network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:36:53 user nova-compute[73208]: WARNING nova.compute.manager [req-1e3609d1-ba78-4212-822f-83bc8f8a79de req-48d39df8-b1d9-406d-a8ee-5063768b748a service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received unexpected event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 for instance with vm_state building and task_state spawning.
Aug 16 09:36:53 user nova-compute[73208]: DEBUG nova.objects.instance [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'flavor' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:36:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e7a8747e-8087-4d12-b7bb-7dd385093a80 tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.177s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-529ece61-9a38-40e9-87f5-b4b5c8cb5633 req-7f2790af-7c48-4c56-9e31-e676810463a3 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-529ece61-9a38-40e9-87f5-b4b5c8cb5633 req-7f2790af-7c48-4c56-9e31-e676810463a3 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-529ece61-9a38-40e9-87f5-b4b5c8cb5633 req-7f2790af-7c48-4c56-9e31-e676810463a3 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-529ece61-9a38-40e9-87f5-b4b5c8cb5633 req-7f2790af-7c48-4c56-9e31-e676810463a3 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-529ece61-9a38-40e9-87f5-b4b5c8cb5633 req-7f2790af-7c48-4c56-9e31-e676810463a3 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:36:54 user nova-compute[73208]: WARNING nova.compute.manager [req-529ece61-9a38-40e9-87f5-b4b5c8cb5633 req-7f2790af-7c48-4c56-9e31-e676810463a3 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state building and task_state spawning.
Aug 16 09:36:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178614.9096098, e54f2b10-5702-49c5-ab1a-da97d4a7ca05 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:36:54 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] VM Resumed (Lifecycle Event)
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:36:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance spawned successfully.
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:54 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:36:54 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178614.9185987, e54f2b10-5702-49c5-ab1a-da97d4a7ca05 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:36:54 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] VM Started (Lifecycle Event)
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Took 8.58 seconds to spawn the instance on the hypervisor.
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178615.05798, 9dd3d75b-db07-4907-854c-42278f817bb9 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] VM Resumed (Lifecycle Event)
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Instance spawned successfully.
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178615.058178, 9dd3d75b-db07-4907-854c-42278f817bb9 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] VM Started (Lifecycle Event)
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Took 9.22 seconds to build instance.
Aug 16 09:36:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4bb355a8-3045-41b7-bdc8-d66393715b00 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.371s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Took 7.53 seconds to spawn the instance on the hypervisor.
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-7a2ff1f3-a215-4791-ba61-829e8b1ed398 req-dde58ea7-c791-4207-ae20-803b6f9f2657 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7a2ff1f3-a215-4791-ba61-829e8b1ed398 req-dde58ea7-c791-4207-ae20-803b6f9f2657 service nova] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7a2ff1f3-a215-4791-ba61-829e8b1ed398 req-dde58ea7-c791-4207-ae20-803b6f9f2657 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7a2ff1f3-a215-4791-ba61-829e8b1ed398 req-dde58ea7-c791-4207-ae20-803b6f9f2657 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:55 user nova-compute[73208]: DEBUG nova.compute.manager [req-7a2ff1f3-a215-4791-ba61-829e8b1ed398 req-dde58ea7-c791-4207-ae20-803b6f9f2657 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] No waiting events found dispatching network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:36:55 user nova-compute[73208]: WARNING nova.compute.manager [req-7a2ff1f3-a215-4791-ba61-829e8b1ed398 req-dde58ea7-c791-4207-ae20-803b6f9f2657 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received unexpected event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 for instance with vm_state building and task_state spawning.
Aug 16 09:36:55 user nova-compute[73208]: INFO nova.compute.manager [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Took 8.32 seconds to build instance.
Aug 16 09:36:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-b80977d5-78d7-4d54-9bb2-0505dbde8424 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9dd3d75b-db07-4907-854c-42278f817bb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.442s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-c784bd0f-f2a6-467d-b78f-0aefe3ad4aef req-bb85306d-7943-41f7-9ed0-f0e5a6ec31fe service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-c784bd0f-f2a6-467d-b78f-0aefe3ad4aef req-bb85306d-7943-41f7-9ed0-f0e5a6ec31fe service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing instance network info cache due to event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c784bd0f-f2a6-467d-b78f-0aefe3ad4aef req-bb85306d-7943-41f7-9ed0-f0e5a6ec31fe service nova] Acquiring lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c784bd0f-f2a6-467d-b78f-0aefe3ad4aef req-bb85306d-7943-41f7-9ed0-f0e5a6ec31fe service nova] Acquired lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-c784bd0f-f2a6-467d-b78f-0aefe3ad4aef req-bb85306d-7943-41f7-9ed0-f0e5a6ec31fe service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:36:56 user nova-compute[73208]: INFO nova.compute.manager [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Detaching volume 70c838e4-7977-495d-97fb-d3f6e05f7f8f
Aug 16 09:36:56 user nova-compute[73208]: INFO nova.virt.block_device [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Attempting to driver detach volume 70c838e4-7977-495d-97fb-d3f6e05f7f8f from mountpoint /dev/vdb
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Attempting to detach device vdb from instance 42f666e9-8880-42ac-9645-bf25038ca521 from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:36:56 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:36:56 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:36:56 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:36:56 user nova-compute[73208]:   <serial>70c838e4-7977-495d-97fb-d3f6e05f7f8f</serial>
Aug 16 09:36:56 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 09:36:56 user nova-compute[73208]: </disk>
Aug 16 09:36:56 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:36:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully detached device vdb from instance 42f666e9-8880-42ac-9645-bf25038ca521 from the persistent domain config.
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42f666e9-8880-42ac-9645-bf25038ca521 from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:36:56 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:36:56 user nova-compute[73208]:   <source dev="/dev/sdb"/>
Aug 16 09:36:56 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:36:56 user nova-compute[73208]:   <serial>70c838e4-7977-495d-97fb-d3f6e05f7f8f</serial>
Aug 16 09:36:56 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 09:36:56 user nova-compute[73208]: </disk>
Aug 16 09:36:56 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-c784bd0f-f2a6-467d-b78f-0aefe3ad4aef req-bb85306d-7943-41f7-9ed0-f0e5a6ec31fe service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updated VIF entry in instance network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-c784bd0f-f2a6-467d-b78f-0aefe3ad4aef req-bb85306d-7943-41f7-9ed0-f0e5a6ec31fe service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:36:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c784bd0f-f2a6-467d-b78f-0aefe3ad4aef req-bb85306d-7943-41f7-9ed0-f0e5a6ec31fe service nova] Releasing lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178617.3038957, 42f666e9-8880-42ac-9645-bf25038ca521 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:36:57 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully detached device vdb from instance 42f666e9-8880-42ac-9645-bf25038ca521 from the live domain config.
Aug 16 09:36:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFfDKOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:36:57 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[72afa4b1-adb4-4ed9-8041-979c483352e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b4151b-4e12-4b1e-bf11-d3faa19289a7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:36:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f (non-flash)
Aug 16 09:36:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f0116560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-2479e8ec-2132-44f6-a000-df0a4f31f1f9 req-3e548f58-5023-488d-96c5-ac421e9439a9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-2479e8ec-2132-44f6-a000-df0a4f31f1f9 req-3e548f58-5023-488d-96c5-ac421e9439a9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing instance network info cache due to event network-changed-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2479e8ec-2132-44f6-a000-df0a4f31f1f9 req-3e548f58-5023-488d-96c5-ac421e9439a9 service nova] Acquiring lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2479e8ec-2132-44f6-a000-df0a4f31f1f9 req-3e548f58-5023-488d-96c5-ac421e9439a9 service nova] Acquired lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG nova.network.neutron [req-2479e8ec-2132-44f6-a000-df0a4f31f1f9 req-3e548f58-5023-488d-96c5-ac421e9439a9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Refreshing network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb5d3f-51f5-4158-8f96-1758577ad0ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[78622fa2-a311-4a3e-8a58-561d880de208]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2008add4-f800-4f32-bcf3-7718289948cf]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965c9c0-6766-41ba-8eee-d480497d4d7f]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[696542ea-34f3-4df7-95c1-31b5a93f35f5]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e7a7ba-faa0-4711-835a-6810912a5b8f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260]
Aug 16 09:36:57 user nova-compute[73208]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f, portal: 172.16.0.220,3260] successful.
Aug 16 09:36:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c838e4-7977-495d-97fb-d3f6e05f7f8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c275f212-3444-4373-a038-9586a6f937c6]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] <== disconnect_volume: return (329ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:36:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:36:58 user nova-compute[73208]: DEBUG nova.network.neutron [req-2479e8ec-2132-44f6-a000-df0a4f31f1f9 req-3e548f58-5023-488d-96c5-ac421e9439a9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updated VIF entry in instance network info cache for port 4ed116d6-1cd7-4da5-b739-9c9f26a0b80b. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:36:58 user nova-compute[73208]: DEBUG nova.network.neutron [req-2479e8ec-2132-44f6-a000-df0a4f31f1f9 req-3e548f58-5023-488d-96c5-ac421e9439a9 service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [{"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:36:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2479e8ec-2132-44f6-a000-df0a4f31f1f9 req-3e548f58-5023-488d-96c5-ac421e9439a9 service nova] Releasing lock "refresh_cache-42f666e9-8880-42ac-9645-bf25038ca521" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:36:58 user nova-compute[73208]: DEBUG nova.objects.instance [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'flavor' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:36:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-deeed0b5-5881-4128-bf1c-382f1e830813 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.974s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:36:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:37:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:34 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:35 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:37:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:37:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:37:35 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:37:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:37 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:37:37 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:37:37 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8296MB free_disk=25.211444854736328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:37:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:37:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance f5067d00-0cd2-40f2-875f-577760762123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 42f666e9-8880-42ac-9645-bf25038ca521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:37:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:37:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "33baf617-b569-4bc0-85a3-3f6611dcffdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:37:42 user nova-compute[73208]: INFO nova.compute.claims [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Claim successful on node user
Aug 16 09:37:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Skipping network cache update for instance because it is Building. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:37:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:37:42 user nova-compute[73208]: INFO nova.virt.block_device [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Booting with volume snapshot 30abf372-cc4f-4c4a-b518-ad79d96cbe3b at /dev/vda
Aug 16 09:37:42 user nova-compute[73208]: DEBUG nova.policy [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae7839fe33794c6bb9c70f3005eab84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae086cfe405c4b9f80eef45ccae6d408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:37:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating instance_info_cache with network_info: [{"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:37:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-f5067d00-0cd2-40f2-875f-577760762123" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:37:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:37:43 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Successfully created port: c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Successfully updated port: c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "refresh_cache-33baf617-b569-4bc0-85a3-3f6611dcffdc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquired lock "refresh_cache-33baf617-b569-4bc0-85a3-3f6611dcffdc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-ba65323d-3981-4121-a7b8-5a0bad039448 req-35ee6fd3-767a-4a67-b960-ecc79f64d64b service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received event network-changed-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-ba65323d-3981-4121-a7b8-5a0bad039448 req-35ee6fd3-767a-4a67-b960-ecc79f64d64b service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Refreshing instance network info cache due to event network-changed-c7f48711-b3cb-4da5-a7fd-76aa3c269653. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba65323d-3981-4121-a7b8-5a0bad039448 req-35ee6fd3-767a-4a67-b960-ecc79f64d64b service nova] Acquiring lock "refresh_cache-33baf617-b569-4bc0-85a3-3f6611dcffdc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Updating instance_info_cache with network_info: [{"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Releasing lock "refresh_cache-33baf617-b569-4bc0-85a3-3f6611dcffdc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Instance network_info: |[{"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba65323d-3981-4121-a7b8-5a0bad039448 req-35ee6fd3-767a-4a67-b960-ecc79f64d64b service nova] Acquired lock "refresh_cache-33baf617-b569-4bc0-85a3-3f6611dcffdc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:37:44 user nova-compute[73208]: DEBUG nova.network.neutron [req-ba65323d-3981-4121-a7b8-5a0bad039448 req-35ee6fd3-767a-4a67-b960-ecc79f64d64b service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Refreshing network info cache for port c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:37:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:45 user nova-compute[73208]: DEBUG nova.network.neutron [req-ba65323d-3981-4121-a7b8-5a0bad039448 req-35ee6fd3-767a-4a67-b960-ecc79f64d64b service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Updated VIF entry in instance network info cache for port c7f48711-b3cb-4da5-a7fd-76aa3c269653. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:37:45 user nova-compute[73208]: DEBUG nova.network.neutron [req-ba65323d-3981-4121-a7b8-5a0bad039448 req-35ee6fd3-767a-4a67-b960-ecc79f64d64b service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Updating instance_info_cache with network_info: [{"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:37:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ba65323d-3981-4121-a7b8-5a0bad039448 req-35ee6fd3-767a-4a67-b960-ecc79f64d64b service nova] Releasing lock "refresh_cache-33baf617-b569-4bc0-85a3-3f6611dcffdc" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:37:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG os_brick.utils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ba5391-62ba-415a-889e-a5811ab56264]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2532e0d8-71f4-4c63-a641-eeb259eda59d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e04c8-4d26-460f-ba89-409164189138]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde92faf-3fe8-474e-9d00-920dcc1f3c37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:37:48 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:37:48 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6c792c-156d-4b56-b371-9f76bd3f4817]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG os_brick.utils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:37:48 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Updating existing volume attachment record: 62a7be6f-a766-41e3-bd29-82c8bf9e26dc {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:37:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:37:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:37:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:37:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:37:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:37:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:58 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:37:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:37:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:37:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:37:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:37:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:37:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:37:59 user nova-compute[73208]: INFO nova.compute.manager [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Terminating instance
Aug 16 09:37:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:37:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-2b9999a7-2bc0-4a94-b8b6-c4c9c2cd309d req-6fc74642-14fd-44a0-9628-019a07a803fb service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-unplugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2b9999a7-2bc0-4a94-b8b6-c4c9c2cd309d req-6fc74642-14fd-44a0-9628-019a07a803fb service nova] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2b9999a7-2bc0-4a94-b8b6-c4c9c2cd309d req-6fc74642-14fd-44a0-9628-019a07a803fb service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2b9999a7-2bc0-4a94-b8b6-c4c9c2cd309d req-6fc74642-14fd-44a0-9628-019a07a803fb service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-2b9999a7-2bc0-4a94-b8b6-c4c9c2cd309d req-6fc74642-14fd-44a0-9628-019a07a803fb service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] No waiting events found dispatching network-vif-unplugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-2b9999a7-2bc0-4a94-b8b6-c4c9c2cd309d req-6fc74642-14fd-44a0-9628-019a07a803fb service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-unplugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:38:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Instance destroyed successfully.
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'resources' on Instance uuid 42f666e9-8880-42ac-9645-bf25038ca521 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-370990005',display_name='tempest-TestMinimumBasicScenario-server-370990005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-370990005',id=42,image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/bvUoe0c9XW9H9zrOQ9LVKbFwIs3jKg/hacX9jbr6f4jH59qxjDPnjAV8HrD3HO6MnF+Yu8Ef+hYeYULT8BU79HFKR08unvstxJ2VDdAFdxipNeZJsLP0XTmeSHKRUrA==',key_name='tempest-TestMinimumBasicScenario-1073759525',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-mfy04f1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6b3f0c68-f252-4874-8dba-0fdc99519093',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:35:10Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=42f666e9-8880-42ac-9645-bf25038ca521,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "address": "fa:16:3e:fc:19:56", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed116d6-1c", "ovs_interfaceid": "4ed116d6-1cd7-4da5-b739-9c9f26a0b80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG os_vif [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ed116d6-1c, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:38:00 user nova-compute[73208]: INFO os_vif [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:19:56,bridge_name='br-int',has_traffic_filtering=True,id=4ed116d6-1cd7-4da5-b739-9c9f26a0b80b,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed116d6-1c')
Aug 16 09:38:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Deleting instance files /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521_del
Aug 16 09:38:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Deletion of /opt/stack/data/nova/instances/42f666e9-8880-42ac-9645-bf25038ca521_del complete
Aug 16 09:38:00 user nova-compute[73208]: INFO nova.compute.manager [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 09:38:00 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:38:00 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:38:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:01 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:38:01 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Took 0.59 seconds to deallocate network for instance.
Aug 16 09:38:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-ce339795-c84c-4fc5-a737-b690125abef6 req-c0d4f901-9e5e-4674-89d3-14b430d4476a service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-deleted-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:01 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:38:01 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:38:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:01 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Deleted allocations for instance 42f666e9-8880-42ac-9645-bf25038ca521
Aug 16 09:38:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-eca2f921-1adc-4b67-8387-4ae61a8c5ce0 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "42f666e9-8880-42ac-9645-bf25038ca521" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.885s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-057278e2-0092-43df-aab5-9f64c7d5acf5 req-10dbfe01-a849-4d24-9447-5dc7f526b23b service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-057278e2-0092-43df-aab5-9f64c7d5acf5 req-10dbfe01-a849-4d24-9447-5dc7f526b23b service nova] Acquiring lock "42f666e9-8880-42ac-9645-bf25038ca521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-057278e2-0092-43df-aab5-9f64c7d5acf5 req-10dbfe01-a849-4d24-9447-5dc7f526b23b service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-057278e2-0092-43df-aab5-9f64c7d5acf5 req-10dbfe01-a849-4d24-9447-5dc7f526b23b service nova] Lock "42f666e9-8880-42ac-9645-bf25038ca521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-057278e2-0092-43df-aab5-9f64c7d5acf5 req-10dbfe01-a849-4d24-9447-5dc7f526b23b service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] No waiting events found dispatching network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:02 user nova-compute[73208]: WARNING nova.compute.manager [req-057278e2-0092-43df-aab5-9f64c7d5acf5 req-10dbfe01-a849-4d24-9447-5dc7f526b23b service nova] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Received unexpected event network-vif-plugged-4ed116d6-1cd7-4da5-b739-9c9f26a0b80b for instance with vm_state deleted and task_state None.
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:38:05 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Creating image(s)
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Ensure instance console log exists: /opt/stack/data/nova/instances/33baf617-b569-4bc0-85a3-3f6611dcffdc/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Start _get_guest_xml network_info=[{"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '62a7be6f-a766-41e3-bd29-82c8bf9e26dc', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjBrTnzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33baf617-b569-4bc0-85a3-3f6611dcffdc', 'attached_at': '', 'detached_at': '', 'volume_id': '2a37db3a-27b4-46e5-a5d1-bb080a079104', 'serial': '2a37db3a-27b4-46e5-a5d1-bb080a079104'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:38:05 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:38:05 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjBrTnzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:38:05 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:38:05 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:38:05 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff21bda7-a610-4eb4-a081-2dd752909b0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:38:05 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[452659ef-550c-497a-911a-f89882a37305]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104] added
Aug 16 09:38:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d312f1-f154-4859-a530-066f577e822b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0754cb-cf9a-4d8d-abd1-9a0780d84293]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjBrTnzO {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjBrTnzO" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e947e8-fe34-41e6-9200-7c073f2b63fb]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qjBrTnzO'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[44282ca5-c914-442e-9349-af829f87bc3b]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d756ebc6-d6c9-4595-b103-67d7cac1716b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:38:05 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:38:05 user nova-compute[73208]:  {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:38:05 user nova-compute[73208]: WARNING os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 09:38:05 user nova-compute[73208]: 
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef0e19a-29fa-4979-9b2c-82db5dbd9aa2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104, portal: 172.16.0.220,3260]
Aug 16 09:38:05 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104, portal: 172.16.0.220,3260] successful.
Aug 16 09:38:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[845afcdd-b6cc-49b9-973b-641fa6f7f6ed]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[41565166-32da-4617-862d-504928c0682c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 (non-flash)
Aug 16 09:38:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 (non-flash)
Aug 16 09:38:05 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[db38ab9e-2c70-491d-92e9-d57b3aa6bd24]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjBrTnzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:38:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23432633264343034', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432633264343034', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1272663822',display_name='tempest-TestVolumeBootPattern-server-1272663822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1272663822',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-6y3cfu2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:37:43Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=33baf617-b569-4bc0-85a3-3f6611dcffdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:16:26,bridge_name='br-int',has_traffic_filtering=True,id=c7f48711-b3cb-4da5-a7fd-76aa3c269653,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f48711-b3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'pci_devices' on Instance uuid 33baf617-b569-4bc0-85a3-3f6611dcffdc {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:38:06 user nova-compute[73208]:   <uuid>33baf617-b569-4bc0-85a3-3f6611dcffdc</uuid>
Aug 16 09:38:06 user nova-compute[73208]:   <name>instance-0000002d</name>
Aug 16 09:38:06 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:38:06 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:38:06 user nova-compute[73208]:   <metadata>
Aug 16 09:38:06 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:38:06 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:38:06 user nova-compute[73208]:       <nova:name>tempest-TestVolumeBootPattern-server-1272663822</nova:name>
Aug 16 09:38:06 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:38:05</nova:creationTime>
Aug 16 09:38:06 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:38:06 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:38:06 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:38:06 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:38:06 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:38:06 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:38:06 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:38:06 user nova-compute[73208]:       <nova:owner>
Aug 16 09:38:06 user nova-compute[73208]:         <nova:user uuid="ae7839fe33794c6bb9c70f3005eab84f">tempest-TestVolumeBootPattern-1567175042-project-member</nova:user>
Aug 16 09:38:06 user nova-compute[73208]:         <nova:project uuid="ae086cfe405c4b9f80eef45ccae6d408">tempest-TestVolumeBootPattern-1567175042</nova:project>
Aug 16 09:38:06 user nova-compute[73208]:       </nova:owner>
Aug 16 09:38:06 user nova-compute[73208]:       <nova:ports>
Aug 16 09:38:06 user nova-compute[73208]:         <nova:port uuid="c7f48711-b3cb-4da5-a7fd-76aa3c269653">
Aug 16 09:38:06 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 09:38:06 user nova-compute[73208]:         </nova:port>
Aug 16 09:38:06 user nova-compute[73208]:       </nova:ports>
Aug 16 09:38:06 user nova-compute[73208]:     </nova:instance>
Aug 16 09:38:06 user nova-compute[73208]:   </metadata>
Aug 16 09:38:06 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:38:06 user nova-compute[73208]:     <system>
Aug 16 09:38:06 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:38:06 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:38:06 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:38:06 user nova-compute[73208]:       <entry name="serial">33baf617-b569-4bc0-85a3-3f6611dcffdc</entry>
Aug 16 09:38:06 user nova-compute[73208]:       <entry name="uuid">33baf617-b569-4bc0-85a3-3f6611dcffdc</entry>
Aug 16 09:38:06 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:38:06 user nova-compute[73208]:     </system>
Aug 16 09:38:06 user nova-compute[73208]:   </sysinfo>
Aug 16 09:38:06 user nova-compute[73208]:   <os>
Aug 16 09:38:06 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:38:06 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:38:06 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:38:06 user nova-compute[73208]:   </os>
Aug 16 09:38:06 user nova-compute[73208]:   <features>
Aug 16 09:38:06 user nova-compute[73208]:     <acpi/>
Aug 16 09:38:06 user nova-compute[73208]:     <apic/>
Aug 16 09:38:06 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:38:06 user nova-compute[73208]:   </features>
Aug 16 09:38:06 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:38:06 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:38:06 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:38:06 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:38:06 user nova-compute[73208]:   </clock>
Aug 16 09:38:06 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:38:06 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:38:06 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:38:06 user nova-compute[73208]:   </cpu>
Aug 16 09:38:06 user nova-compute[73208]:   <devices>
Aug 16 09:38:06 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:38:06 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:38:06 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:38:06 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:38:06 user nova-compute[73208]:       <serial>2a37db3a-27b4-46e5-a5d1-bb080a079104</serial>
Aug 16 09:38:06 user nova-compute[73208]:     </disk>
Aug 16 09:38:06 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:38:06 user nova-compute[73208]:       <mac address="fa:16:3e:13:16:26"/>
Aug 16 09:38:06 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:38:06 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:38:06 user nova-compute[73208]:       <target dev="tapc7f48711-b3"/>
Aug 16 09:38:06 user nova-compute[73208]:     </interface>
Aug 16 09:38:06 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:38:06 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/33baf617-b569-4bc0-85a3-3f6611dcffdc/console.log" append="off"/>
Aug 16 09:38:06 user nova-compute[73208]:     </serial>
Aug 16 09:38:06 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:38:06 user nova-compute[73208]:     <video>
Aug 16 09:38:06 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:38:06 user nova-compute[73208]:     </video>
Aug 16 09:38:06 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:38:06 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:38:06 user nova-compute[73208]:     </rng>
Aug 16 09:38:06 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:38:06 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:38:06 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:38:06 user nova-compute[73208]:     </memballoon>
Aug 16 09:38:06 user nova-compute[73208]:   </devices>
Aug 16 09:38:06 user nova-compute[73208]: </domain>
Aug 16 09:38:06 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1272663822',display_name='tempest-TestVolumeBootPattern-server-1272663822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1272663822',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-6y3cfu2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:37:43Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=33baf617-b569-4bc0-85a3-3f6611dcffdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:16:26,bridge_name='br-int',has_traffic_filtering=True,id=c7f48711-b3cb-4da5-a7fd-76aa3c269653,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f48711-b3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG os_vif [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:16:26,bridge_name='br-int',has_traffic_filtering=True,id=c7f48711-b3cb-4da5-a7fd-76aa3c269653,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f48711-b3') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7f48711-b3, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7f48711-b3, col_values=(('external_ids', {'iface-id': 'c7f48711-b3cb-4da5-a7fd-76aa3c269653', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:16:26', 'vm-uuid': '33baf617-b569-4bc0-85a3-3f6611dcffdc'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:06 user nova-compute[73208]: INFO os_vif [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:16:26,bridge_name='br-int',has_traffic_filtering=True,id=c7f48711-b3cb-4da5-a7fd-76aa3c269653,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f48711-b3')
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:38:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No VIF found with MAC fa:16:3e:13:16:26, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:38:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-9e634f17-b240-48fc-a5b8-70fb6965b4ec req-b0ec3fd6-b4f3-43d5-a504-1cf01440e8c9 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received event network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e634f17-b240-48fc-a5b8-70fb6965b4ec req-b0ec3fd6-b4f3-43d5-a504-1cf01440e8c9 service nova] Acquiring lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e634f17-b240-48fc-a5b8-70fb6965b4ec req-b0ec3fd6-b4f3-43d5-a504-1cf01440e8c9 service nova] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9e634f17-b240-48fc-a5b8-70fb6965b4ec req-b0ec3fd6-b4f3-43d5-a504-1cf01440e8c9 service nova] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-9e634f17-b240-48fc-a5b8-70fb6965b4ec req-b0ec3fd6-b4f3-43d5-a504-1cf01440e8c9 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] No waiting events found dispatching network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:08 user nova-compute[73208]: WARNING nova.compute.manager [req-9e634f17-b240-48fc-a5b8-70fb6965b4ec req-b0ec3fd6-b4f3-43d5-a504-1cf01440e8c9 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received unexpected event network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 for instance with vm_state building and task_state spawning.
Aug 16 09:38:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178690.011347, 33baf617-b569-4bc0-85a3-3f6611dcffdc => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:38:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] VM Resumed (Lifecycle Event)
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:38:10 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Instance spawned successfully.
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:38:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178690.0146801, 33baf617-b569-4bc0-85a3-3f6611dcffdc => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:38:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] VM Started (Lifecycle Event)
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:38:10 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:38:10 user nova-compute[73208]: INFO nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:38:10 user nova-compute[73208]: INFO nova.compute.manager [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Took 27.80 seconds to build instance.
Aug 16 09:38:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a7c62e12-a12b-4146-ad54-98e147877119 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.895s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-cfacd224-e596-434b-a639-5013ef8190d0 req-a207ddd4-ec8f-478c-8e25-84c0a5b04d49 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received event network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cfacd224-e596-434b-a639-5013ef8190d0 req-a207ddd4-ec8f-478c-8e25-84c0a5b04d49 service nova] Acquiring lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cfacd224-e596-434b-a639-5013ef8190d0 req-a207ddd4-ec8f-478c-8e25-84c0a5b04d49 service nova] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-cfacd224-e596-434b-a639-5013ef8190d0 req-a207ddd4-ec8f-478c-8e25-84c0a5b04d49 service nova] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-cfacd224-e596-434b-a639-5013ef8190d0 req-a207ddd4-ec8f-478c-8e25-84c0a5b04d49 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] No waiting events found dispatching network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:10 user nova-compute[73208]: WARNING nova.compute.manager [req-cfacd224-e596-434b-a639-5013ef8190d0 req-a207ddd4-ec8f-478c-8e25-84c0a5b04d49 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received unexpected event network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 for instance with vm_state active and task_state None.
Aug 16 09:38:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:15 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178680.6681564, 42f666e9-8880-42ac-9645-bf25038ca521 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:38:15 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] VM Stopped (Lifecycle Event)
Aug 16 09:38:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f8a0fe4d-2d47-40c7-b40d-58a0212dd5d1 None None] [instance: 42f666e9-8880-42ac-9645-bf25038ca521] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:38:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:38:19 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:38:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:38:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: INFO nova.compute.manager [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Rescuing
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquired lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:37 user nova-compute[73208]: INFO nova.compute.manager [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Terminating instance
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-382a3733-3a4a-4358-8c90-4a62e6ff8879 req-4f274ac0-9b1a-44b7-8c1d-9a5cdb3ded92 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received event network-vif-unplugged-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-382a3733-3a4a-4358-8c90-4a62e6ff8879 req-4f274ac0-9b1a-44b7-8c1d-9a5cdb3ded92 service nova] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-382a3733-3a4a-4358-8c90-4a62e6ff8879 req-4f274ac0-9b1a-44b7-8c1d-9a5cdb3ded92 service nova] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-382a3733-3a4a-4358-8c90-4a62e6ff8879 req-4f274ac0-9b1a-44b7-8c1d-9a5cdb3ded92 service nova] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-382a3733-3a4a-4358-8c90-4a62e6ff8879 req-4f274ac0-9b1a-44b7-8c1d-9a5cdb3ded92 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] No waiting events found dispatching network-vif-unplugged-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-382a3733-3a4a-4358-8c90-4a62e6ff8879 req-4f274ac0-9b1a-44b7-8c1d-9a5cdb3ded92 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received event network-vif-unplugged-3924f9e2-9ac8-4f12-97b4-49527111727e for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.network.neutron [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Releasing lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: f5067d00-0cd2-40f2-875f-577760762123] Instance destroyed successfully.
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lazy-loading 'resources' on Instance uuid f5067d00-0cd2-40f2-875f-577760762123 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1032232702',display_name='tempest-SnapshotDataIntegrityTests-server-1032232702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1032232702',id=40,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvg8mmaEklLVytWliF0azBRQqVdVoQZTY6FA5pK9oIgTUZore3DQot/n/kVQ8VQmpEzybpn1JjXSiqH2lU0sysgLWfbcRBD3qLkypq39kWTn6CMIZ3e0KrZik8QLrjAg==',key_name='tempest-keypair-1559570417',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:30:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8034f56136441b39297e22b45bb45bb',ramdisk_id='',reservation_id='r-8dywigvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1282605912',owner_user_name='tempest-SnapshotDataIntegrityTests-1282605912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9e580b08b3c4aedac129af68b52bc1d',uuid=f5067d00-0cd2-40f2-875f-577760762123,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Converting VIF {"id": "3924f9e2-9ac8-4f12-97b4-49527111727e", "address": "fa:16:3e:0e:b5:ea", "network": {"id": "25b67f1b-0251-42a3-938d-da8bbc0470af", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1741232136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8034f56136441b39297e22b45bb45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3924f9e2-9a", "ovs_interfaceid": "3924f9e2-9ac8-4f12-97b4-49527111727e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:b5:ea,bridge_name='br-int',has_traffic_filtering=True,id=3924f9e2-9ac8-4f12-97b4-49527111727e,network=Network(25b67f1b-0251-42a3-938d-da8bbc0470af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3924f9e2-9a') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG os_vif [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:b5:ea,bridge_name='br-int',has_traffic_filtering=True,id=3924f9e2-9ac8-4f12-97b4-49527111727e,network=Network(25b67f1b-0251-42a3-938d-da8bbc0470af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3924f9e2-9a') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3924f9e2-9a, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:37 user nova-compute[73208]: INFO os_vif [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:b5:ea,bridge_name='br-int',has_traffic_filtering=True,id=3924f9e2-9ac8-4f12-97b4-49527111727e,network=Network(25b67f1b-0251-42a3-938d-da8bbc0470af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3924f9e2-9a')
Aug 16 09:38:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Deleting instance files /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123_del
Aug 16 09:38:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Deletion of /opt/stack/data/nova/instances/f5067d00-0cd2-40f2-875f-577760762123_del complete
Aug 16 09:38:38 user nova-compute[73208]: INFO nova.compute.manager [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] [instance: f5067d00-0cd2-40f2-875f-577760762123] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: f5067d00-0cd2-40f2-875f-577760762123] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: f5067d00-0cd2-40f2-875f-577760762123] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:38 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Instance destroyed successfully.
Aug 16 09:38:38 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Attempting rescue
Aug 16 09:38:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73208) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Instance directory exists: not creating {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 09:38:38 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Creating image(s)
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue" returned: 0 in 0.053s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:38 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'migration_context' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Start _get_guest_xml network_info=[{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:dc:6f:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'resources' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'numa_topology' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:39 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:38:39 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-316213984',display_name='tempest-ServerRescueNegativeTestJSON-server-316213984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-316213984',id=44,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:36:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-9dwyltan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:36:55Z,user_data=None,user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=9dd3d75b-db07-4907-854c-42278f817bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:dc:6f:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:dc:6f:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6f:98,bridge_name='br-int',has_traffic_filtering=True,id=be56fa8f-019f-4784-8ac5-52519e145898,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe56fa8f-01') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:38:39 user nova-compute[73208]:   <uuid>9dd3d75b-db07-4907-854c-42278f817bb9</uuid>
Aug 16 09:38:39 user nova-compute[73208]:   <name>instance-0000002c</name>
Aug 16 09:38:39 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:38:39 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:38:39 user nova-compute[73208]:   <metadata>
Aug 16 09:38:39 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:38:39 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:38:39 user nova-compute[73208]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-316213984</nova:name>
Aug 16 09:38:39 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:38:39</nova:creationTime>
Aug 16 09:38:39 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:38:39 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:38:39 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:38:39 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:38:39 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:38:39 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:38:39 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:38:39 user nova-compute[73208]:       <nova:owner>
Aug 16 09:38:39 user nova-compute[73208]:         <nova:user uuid="a1fe7fe8c35c42aeaf87cf3c4d4a37d8">tempest-ServerRescueNegativeTestJSON-1153173897-project-member</nova:user>
Aug 16 09:38:39 user nova-compute[73208]:         <nova:project uuid="9e197c75147746a282a02c61bba8ef65">tempest-ServerRescueNegativeTestJSON-1153173897</nova:project>
Aug 16 09:38:39 user nova-compute[73208]:       </nova:owner>
Aug 16 09:38:39 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:38:39 user nova-compute[73208]:       <nova:ports>
Aug 16 09:38:39 user nova-compute[73208]:         <nova:port uuid="be56fa8f-019f-4784-8ac5-52519e145898">
Aug 16 09:38:39 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 09:38:39 user nova-compute[73208]:         </nova:port>
Aug 16 09:38:39 user nova-compute[73208]:       </nova:ports>
Aug 16 09:38:39 user nova-compute[73208]:     </nova:instance>
Aug 16 09:38:39 user nova-compute[73208]:   </metadata>
Aug 16 09:38:39 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:38:39 user nova-compute[73208]:     <system>
Aug 16 09:38:39 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:38:39 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:38:39 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:38:39 user nova-compute[73208]:       <entry name="serial">9dd3d75b-db07-4907-854c-42278f817bb9</entry>
Aug 16 09:38:39 user nova-compute[73208]:       <entry name="uuid">9dd3d75b-db07-4907-854c-42278f817bb9</entry>
Aug 16 09:38:39 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:38:39 user nova-compute[73208]:     </system>
Aug 16 09:38:39 user nova-compute[73208]:   </sysinfo>
Aug 16 09:38:39 user nova-compute[73208]:   <os>
Aug 16 09:38:39 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:38:39 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:38:39 user nova-compute[73208]:   </os>
Aug 16 09:38:39 user nova-compute[73208]:   <features>
Aug 16 09:38:39 user nova-compute[73208]:     <acpi/>
Aug 16 09:38:39 user nova-compute[73208]:     <apic/>
Aug 16 09:38:39 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:38:39 user nova-compute[73208]:   </features>
Aug 16 09:38:39 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:38:39 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:38:39 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:38:39 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:38:39 user nova-compute[73208]:   </clock>
Aug 16 09:38:39 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:38:39 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:38:39 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:38:39 user nova-compute[73208]:   </cpu>
Aug 16 09:38:39 user nova-compute[73208]:   <devices>
Aug 16 09:38:39 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:38:39 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:38:39 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue"/>
Aug 16 09:38:39 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:38:39 user nova-compute[73208]:     </disk>
Aug 16 09:38:39 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:38:39 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:38:39 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk"/>
Aug 16 09:38:39 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:38:39 user nova-compute[73208]:     </disk>
Aug 16 09:38:39 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:38:39 user nova-compute[73208]:       <mac address="fa:16:3e:dc:6f:98"/>
Aug 16 09:38:39 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:38:39 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:38:39 user nova-compute[73208]:       <target dev="tapbe56fa8f-01"/>
Aug 16 09:38:39 user nova-compute[73208]:     </interface>
Aug 16 09:38:39 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:38:39 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/console.log" append="off"/>
Aug 16 09:38:39 user nova-compute[73208]:     </serial>
Aug 16 09:38:39 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:38:39 user nova-compute[73208]:     <video>
Aug 16 09:38:39 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:38:39 user nova-compute[73208]:     </video>
Aug 16 09:38:39 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:38:39 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:38:39 user nova-compute[73208]:     </rng>
Aug 16 09:38:39 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:38:39 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:38:39 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:38:39 user nova-compute[73208]:     </memballoon>
Aug 16 09:38:39 user nova-compute[73208]:   </devices>
Aug 16 09:38:39 user nova-compute[73208]: </domain>
Aug 16 09:38:39 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:38:39 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Instance destroyed successfully.
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No VIF found with MAC fa:16:3e:dc:6f:98, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-a28f7ffc-c241-46a0-a444-76092f566988 req-513ea084-368a-4f11-b872-eaad4e4f9e4e service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received event network-vif-deleted-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:39 user nova-compute[73208]: INFO nova.compute.manager [req-a28f7ffc-c241-46a0-a444-76092f566988 req-513ea084-368a-4f11-b872-eaad4e4f9e4e service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Neutron deleted interface 3924f9e2-9ac8-4f12-97b4-49527111727e; detaching it from the instance and deleting it from the info cache
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-a28f7ffc-c241-46a0-a444-76092f566988 req-513ea084-368a-4f11-b872-eaad4e4f9e4e service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: f5067d00-0cd2-40f2-875f-577760762123] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:38:39 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: f5067d00-0cd2-40f2-875f-577760762123] Took 1.43 seconds to deallocate network for instance.
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-a28f7ffc-c241-46a0-a444-76092f566988 req-513ea084-368a-4f11-b872-eaad4e4f9e4e service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Detach interface failed, port_id=3924f9e2-9ac8-4f12-97b4-49527111727e, reason: Instance f5067d00-0cd2-40f2-875f-577760762123 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received event network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Acquiring lock "f5067d00-0cd2-40f2-875f-577760762123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Lock "f5067d00-0cd2-40f2-875f-577760762123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] No waiting events found dispatching network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:39 user nova-compute[73208]: WARNING nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: f5067d00-0cd2-40f2-875f-577760762123] Received unexpected event network-vif-plugged-3924f9e2-9ac8-4f12-97b4-49527111727e for instance with vm_state deleted and task_state None.
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-unplugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] No waiting events found dispatching network-vif-unplugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:39 user nova-compute[73208]: WARNING nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received unexpected event network-vif-unplugged-be56fa8f-019f-4784-8ac5-52519e145898 for instance with vm_state active and task_state rescuing.
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] No waiting events found dispatching network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:39 user nova-compute[73208]: WARNING nova.compute.manager [req-93514504-9e23-47a4-869a-dacae7c0a080 req-800e2aba-aa9b-4035-b386-4cdee306ad06 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received unexpected event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 for instance with vm_state active and task_state rescuing.
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:39 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:38:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:40 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:38:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:42 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Deleted allocations for instance f5067d00-0cd2-40f2-875f-577760762123
Aug 16 09:38:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for 9dd3d75b-db07-4907-854c-42278f817bb9 due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178722.7881052, 9dd3d75b-db07-4907-854c-42278f817bb9 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:38:42 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] VM Resumed (Lifecycle Event)
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] No waiting events found dispatching network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:42 user nova-compute[73208]: WARNING nova.compute.manager [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received unexpected event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 for instance with vm_state active and task_state rescuing.
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] No waiting events found dispatching network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:42 user nova-compute[73208]: WARNING nova.compute.manager [req-289f31d4-acd3-4d7c-9d19-9874b5e6d834 req-7d3f68c7-2ae5-47b1-ad1b-fa37aa1caf75 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received unexpected event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 for instance with vm_state active and task_state rescuing.
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a814fda4-86af-4f16-921f-af54bb02f7c1 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:38:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:38:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=25.236682891845703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:38:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178722.7901278, 9dd3d75b-db07-4907-854c-42278f817bb9 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:38:43 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] VM Started (Lifecycle Event)
Aug 16 09:38:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2b37e55a-a262-4f48-9f75-ba0689ca329c tempest-SnapshotDataIntegrityTests-1282605912 tempest-SnapshotDataIntegrityTests-1282605912-project-member] Lock "f5067d00-0cd2-40f2-875f-577760762123" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.884s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 33baf617-b569-4bc0-85a3-3f6611dcffdc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:38:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:38:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:38:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:38:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:38:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:38:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:38:52 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178717.902266, f5067d00-0cd2-40f2-875f-577760762123 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:38:52 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: f5067d00-0cd2-40f2-875f-577760762123] VM Stopped (Lifecycle Event)
Aug 16 09:38:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-950350fd-8040-4969-ab05-f79fc7bcf000 None None] [instance: f5067d00-0cd2-40f2-875f-577760762123] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:38:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:38:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:38:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:53 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:38:53 user nova-compute[73208]: INFO nova.compute.claims [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Claim successful on node user
Aug 16 09:38:53 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:38:53 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:38:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:38:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG nova.policy [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c8d33aff1c142f0b93dbfe203ca040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0176f0acf145c799a0ec1fbdc2fef7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:38:54 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Creating image(s)
Aug 16 09:38:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "/opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "/opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "/opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "6e01b078924a3a735714c324a2d4cdcbf2d8c699" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "6e01b078924a3a735714c324a2d4cdcbf2d8c699" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:54 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699.part --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699.part --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG nova.virt.images [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] 2193f7d5-cda9-4e7d-83d8-efeaad7cbb88 was qcow2, converting to raw {{(pid=73208) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG nova.privsep.utils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73208) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699.part /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699.converted {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Successfully created port: 8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699.part /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699.converted" returned: 0 in 0.169s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699.converted --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "6e01b078924a3a735714c324a2d4cdcbf2d8c699" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.177s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699 --force-share --output=json" returned: 0 in 0.236s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "6e01b078924a3a735714c324a2d4cdcbf2d8c699" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "6e01b078924a3a735714c324a2d4cdcbf2d8c699" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699 --force-share --output=json" returned: 0 in 0.201s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699,backing_fmt=raw /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699,backing_fmt=raw /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk 1073741824" returned: 0 in 0.054s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "6e01b078924a3a735714c324a2d4cdcbf2d8c699" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:55 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Successfully updated port: 8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquired lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-b09997b9-bb06-4d1c-8f21-24557bf69398 req-6f8bc865-718d-4551-a500-f475f9e2be68 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-b09997b9-bb06-4d1c-8f21-24557bf69398 req-6f8bc865-718d-4551-a500-f475f9e2be68 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing instance network info cache due to event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b09997b9-bb06-4d1c-8f21-24557bf69398 req-6f8bc865-718d-4551-a500-f475f9e2be68 service nova] Acquiring lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699 --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Cannot resize image /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'migration_context' on Instance uuid 3253f62c-2ebf-4f53-bc64-91be81ed9d4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Ensure instance console log exists: /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Releasing lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Instance network_info: |[{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b09997b9-bb06-4d1c-8f21-24557bf69398 req-6f8bc865-718d-4551-a500-f475f9e2be68 service nova] Acquired lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-b09997b9-bb06-4d1c-8f21-24557bf69398 req-6f8bc865-718d-4551-a500-f475f9e2be68 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Start _get_guest_xml network_info=[{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:38:51Z,direct_url=<?>,disk_format='qcow2',id=2193f7d5-cda9-4e7d-83d8-efeaad7cbb88,min_disk=0,min_ram=0,name='tempest-scenario-img--1974050283',owner='3b0176f0acf145c799a0ec1fbdc2fef7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:38:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '2193f7d5-cda9-4e7d-83d8-efeaad7cbb88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:38:56 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:38:56 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:38:51Z,direct_url=<?>,disk_format='qcow2',id=2193f7d5-cda9-4e7d-83d8-efeaad7cbb88,min_disk=0,min_ram=0,name='tempest-scenario-img--1974050283',owner='3b0176f0acf145c799a0ec1fbdc2fef7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:38:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-554114254',display_name='tempest-TestMinimumBasicScenario-server-554114254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-554114254',id=46,image_ref='2193f7d5-cda9-4e7d-83d8-efeaad7cbb88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUJlEIByCvHxbgBIB/n+Sm44qxiwXxP38mvKJL/1BRFxrf3Xwr778wtmFc/B3ypb+rBnt8ki2m49+SHJbI2G+1JQsKycRO9RQAy0huMl6QGZ7u8FKQXyXSWx6RPi5W8dw==',key_name='tempest-TestMinimumBasicScenario-826566296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-7revain1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2193f7d5-cda9-4e7d-83d8-efeaad7cbb88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:38:54Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=3253f62c-2ebf-4f53-bc64-91be81ed9d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c6:bf,bridge_name='br-int',has_traffic_filtering=True,id=8b63cea2-cde7-4498-ba81-fc7574d80cc6,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b63cea2-cd') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'pci_devices' on Instance uuid 3253f62c-2ebf-4f53-bc64-91be81ed9d4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:38:56 user nova-compute[73208]:   <uuid>3253f62c-2ebf-4f53-bc64-91be81ed9d4f</uuid>
Aug 16 09:38:56 user nova-compute[73208]:   <name>instance-0000002e</name>
Aug 16 09:38:56 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:38:56 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:38:56 user nova-compute[73208]:   <metadata>
Aug 16 09:38:56 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:38:56 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:38:56 user nova-compute[73208]:       <nova:name>tempest-TestMinimumBasicScenario-server-554114254</nova:name>
Aug 16 09:38:56 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:38:56</nova:creationTime>
Aug 16 09:38:56 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:38:56 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:38:56 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:38:56 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:38:56 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:38:56 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:38:56 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:38:56 user nova-compute[73208]:       <nova:owner>
Aug 16 09:38:56 user nova-compute[73208]:         <nova:user uuid="8c8d33aff1c142f0b93dbfe203ca040f">tempest-TestMinimumBasicScenario-1791382392-project-member</nova:user>
Aug 16 09:38:56 user nova-compute[73208]:         <nova:project uuid="3b0176f0acf145c799a0ec1fbdc2fef7">tempest-TestMinimumBasicScenario-1791382392</nova:project>
Aug 16 09:38:56 user nova-compute[73208]:       </nova:owner>
Aug 16 09:38:56 user nova-compute[73208]:       <nova:root type="image" uuid="2193f7d5-cda9-4e7d-83d8-efeaad7cbb88"/>
Aug 16 09:38:56 user nova-compute[73208]:       <nova:ports>
Aug 16 09:38:56 user nova-compute[73208]:         <nova:port uuid="8b63cea2-cde7-4498-ba81-fc7574d80cc6">
Aug 16 09:38:56 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 09:38:56 user nova-compute[73208]:         </nova:port>
Aug 16 09:38:56 user nova-compute[73208]:       </nova:ports>
Aug 16 09:38:56 user nova-compute[73208]:     </nova:instance>
Aug 16 09:38:56 user nova-compute[73208]:   </metadata>
Aug 16 09:38:56 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:38:56 user nova-compute[73208]:     <system>
Aug 16 09:38:56 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:38:56 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:38:56 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:38:56 user nova-compute[73208]:       <entry name="serial">3253f62c-2ebf-4f53-bc64-91be81ed9d4f</entry>
Aug 16 09:38:56 user nova-compute[73208]:       <entry name="uuid">3253f62c-2ebf-4f53-bc64-91be81ed9d4f</entry>
Aug 16 09:38:56 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:38:56 user nova-compute[73208]:     </system>
Aug 16 09:38:56 user nova-compute[73208]:   </sysinfo>
Aug 16 09:38:56 user nova-compute[73208]:   <os>
Aug 16 09:38:56 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:38:56 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:38:56 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:38:56 user nova-compute[73208]:   </os>
Aug 16 09:38:56 user nova-compute[73208]:   <features>
Aug 16 09:38:56 user nova-compute[73208]:     <acpi/>
Aug 16 09:38:56 user nova-compute[73208]:     <apic/>
Aug 16 09:38:56 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:38:56 user nova-compute[73208]:   </features>
Aug 16 09:38:56 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:38:56 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:38:56 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:38:56 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:38:56 user nova-compute[73208]:   </clock>
Aug 16 09:38:56 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:38:56 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:38:56 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:38:56 user nova-compute[73208]:   </cpu>
Aug 16 09:38:56 user nova-compute[73208]:   <devices>
Aug 16 09:38:56 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:38:56 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:38:56 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk"/>
Aug 16 09:38:56 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:38:56 user nova-compute[73208]:     </disk>
Aug 16 09:38:56 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:38:56 user nova-compute[73208]:       <mac address="fa:16:3e:cb:c6:bf"/>
Aug 16 09:38:56 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:38:56 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:38:56 user nova-compute[73208]:       <target dev="tap8b63cea2-cd"/>
Aug 16 09:38:56 user nova-compute[73208]:     </interface>
Aug 16 09:38:56 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:38:56 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/console.log" append="off"/>
Aug 16 09:38:56 user nova-compute[73208]:     </serial>
Aug 16 09:38:56 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:38:56 user nova-compute[73208]:     <video>
Aug 16 09:38:56 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:38:56 user nova-compute[73208]:     </video>
Aug 16 09:38:56 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:38:56 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:38:56 user nova-compute[73208]:     </rng>
Aug 16 09:38:56 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:38:56 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:38:56 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:38:56 user nova-compute[73208]:     </memballoon>
Aug 16 09:38:56 user nova-compute[73208]:   </devices>
Aug 16 09:38:56 user nova-compute[73208]: </domain>
Aug 16 09:38:56 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-554114254',display_name='tempest-TestMinimumBasicScenario-server-554114254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-554114254',id=46,image_ref='2193f7d5-cda9-4e7d-83d8-efeaad7cbb88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUJlEIByCvHxbgBIB/n+Sm44qxiwXxP38mvKJL/1BRFxrf3Xwr778wtmFc/B3ypb+rBnt8ki2m49+SHJbI2G+1JQsKycRO9RQAy0huMl6QGZ7u8FKQXyXSWx6RPi5W8dw==',key_name='tempest-TestMinimumBasicScenario-826566296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-7revain1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2193f7d5-cda9-4e7d-83d8-efeaad7cbb88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:38:54Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=3253f62c-2ebf-4f53-bc64-91be81ed9d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c6:bf,bridge_name='br-int',has_traffic_filtering=True,id=8b63cea2-cde7-4498-ba81-fc7574d80cc6,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b63cea2-cd') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG os_vif [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c6:bf,bridge_name='br-int',has_traffic_filtering=True,id=8b63cea2-cde7-4498-ba81-fc7574d80cc6,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b63cea2-cd') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b63cea2-cd, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b63cea2-cd, col_values=(('external_ids', {'iface-id': '8b63cea2-cde7-4498-ba81-fc7574d80cc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:c6:bf', 'vm-uuid': '3253f62c-2ebf-4f53-bc64-91be81ed9d4f'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:56 user nova-compute[73208]: INFO os_vif [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c6:bf,bridge_name='br-int',has_traffic_filtering=True,id=8b63cea2-cde7-4498-ba81-fc7574d80cc6,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b63cea2-cd')
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No VIF found with MAC fa:16:3e:cb:c6:bf, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-b09997b9-bb06-4d1c-8f21-24557bf69398 req-6f8bc865-718d-4551-a500-f475f9e2be68 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updated VIF entry in instance network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG nova.network.neutron [req-b09997b9-bb06-4d1c-8f21-24557bf69398 req-6f8bc865-718d-4551-a500-f475f9e2be68 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:38:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-b09997b9-bb06-4d1c-8f21-24557bf69398 req-6f8bc865-718d-4551-a500-f475f9e2be68 service nova] Releasing lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:38:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-1e44ab88-4716-4348-8f3d-00a9889cf17f req-7bba37fd-2a13-47f8-8fa8-502df9ccc272 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:38:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e44ab88-4716-4348-8f3d-00a9889cf17f req-7bba37fd-2a13-47f8-8fa8-502df9ccc272 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:38:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e44ab88-4716-4348-8f3d-00a9889cf17f req-7bba37fd-2a13-47f8-8fa8-502df9ccc272 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:38:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1e44ab88-4716-4348-8f3d-00a9889cf17f req-7bba37fd-2a13-47f8-8fa8-502df9ccc272 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:38:58 user nova-compute[73208]: DEBUG nova.compute.manager [req-1e44ab88-4716-4348-8f3d-00a9889cf17f req-7bba37fd-2a13-47f8-8fa8-502df9ccc272 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:38:58 user nova-compute[73208]: WARNING nova.compute.manager [req-1e44ab88-4716-4348-8f3d-00a9889cf17f req-7bba37fd-2a13-47f8-8fa8-502df9ccc272 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state building and task_state spawning.
Aug 16 09:38:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:38:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178740.0140948, 3253f62c-2ebf-4f53-bc64-91be81ed9d4f => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:39:00 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] VM Resumed (Lifecycle Event)
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:39:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Instance spawned successfully.
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:39:00 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178740.0181575, 3253f62c-2ebf-4f53-bc64-91be81ed9d4f => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:39:00 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] VM Started (Lifecycle Event)
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:39:00 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:39:00 user nova-compute[73208]: INFO nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:39:00 user nova-compute[73208]: INFO nova.compute.manager [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Took 6.45 seconds to build instance.
Aug 16 09:39:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d975fd01-6a28-43eb-88a5-fc99cbfde0d9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.551s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-24a7a99f-8819-4ed7-8bd0-f5ea8aa87a7d req-63ec13f4-2c2c-46d1-a89a-6e2109593702 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-24a7a99f-8819-4ed7-8bd0-f5ea8aa87a7d req-63ec13f4-2c2c-46d1-a89a-6e2109593702 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-24a7a99f-8819-4ed7-8bd0-f5ea8aa87a7d req-63ec13f4-2c2c-46d1-a89a-6e2109593702 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-24a7a99f-8819-4ed7-8bd0-f5ea8aa87a7d req-63ec13f4-2c2c-46d1-a89a-6e2109593702 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-24a7a99f-8819-4ed7-8bd0-f5ea8aa87a7d req-63ec13f4-2c2c-46d1-a89a-6e2109593702 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:39:00 user nova-compute[73208]: WARNING nova.compute.manager [req-24a7a99f-8819-4ed7-8bd0-f5ea8aa87a7d req-63ec13f4-2c2c-46d1-a89a-6e2109593702 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state None.
Aug 16 09:39:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "33baf617-b569-4bc0-85a3-3f6611dcffdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:33 user nova-compute[73208]: INFO nova.compute.manager [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Terminating instance
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-a4a087ec-f5a2-4ea1-b736-fd53961a05d8 req-832d58d7-9cec-486a-bed0-073c2700f483 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received event network-vif-unplugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a4a087ec-f5a2-4ea1-b736-fd53961a05d8 req-832d58d7-9cec-486a-bed0-073c2700f483 service nova] Acquiring lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a4a087ec-f5a2-4ea1-b736-fd53961a05d8 req-832d58d7-9cec-486a-bed0-073c2700f483 service nova] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a4a087ec-f5a2-4ea1-b736-fd53961a05d8 req-832d58d7-9cec-486a-bed0-073c2700f483 service nova] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-a4a087ec-f5a2-4ea1-b736-fd53961a05d8 req-832d58d7-9cec-486a-bed0-073c2700f483 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] No waiting events found dispatching network-vif-unplugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-a4a087ec-f5a2-4ea1-b736-fd53961a05d8 req-832d58d7-9cec-486a-bed0-073c2700f483 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received event network-vif-unplugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:39:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Instance destroyed successfully.
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'resources' on Instance uuid 33baf617-b569-4bc0-85a3-3f6611dcffdc {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1272663822',display_name='tempest-TestVolumeBootPattern-server-1272663822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1272663822',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:38:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-6y3cfu2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:38:10Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=33baf617-b569-4bc0-85a3-3f6611dcffdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "address": "fa:16:3e:13:16:26", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f48711-b3", "ovs_interfaceid": "c7f48711-b3cb-4da5-a7fd-76aa3c269653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:16:26,bridge_name='br-int',has_traffic_filtering=True,id=c7f48711-b3cb-4da5-a7fd-76aa3c269653,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f48711-b3') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_vif [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:16:26,bridge_name='br-int',has_traffic_filtering=True,id=c7f48711-b3cb-4da5-a7fd-76aa3c269653,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f48711-b3') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7f48711-b3, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:39:33 user nova-compute[73208]: INFO os_vif [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:16:26,bridge_name='br-int',has_traffic_filtering=True,id=c7f48711-b3cb-4da5-a7fd-76aa3c269653,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f48711-b3')
Aug 16 09:39:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjBrTnzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:39:33 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f2ef5e-418b-4bb6-b373-9c4707a82467]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10aaffa-9369-4c65-a3e5-43d1497ff35c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 (non-flash)
Aug 16 09:39:33 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 (non-flash)
Aug 16 09:39:33 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6b072b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4280e56-4e23-4fc7-8789-2fbe9ca2eb0c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9619e60b-927b-4605-bfcb-478728735dbb]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d276e7-0436-43db-9e79-7491d55fbaed]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e31800-c2ec-44b5-9b98-a6501e6c3d29]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c61f866f', '/dev/disk/by-id/scsi-1SCST_BIOc61f866f-42c2d404907f4d75', '/dev/disk/by-id/scsi-23432633264343034') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fd121c-5b9e-4248-a877-888d01fa697d]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[859ec67d-5af2-4ccd-9fe1-5a4dd957f5f0]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:39:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d97996c-a0fc-4e5f-abcd-7be8d79345d6]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104, portal: 172.16.0.220,3260]
Aug 16 09:39:34 user nova-compute[73208]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104, portal: 172.16.0.220,3260] successful.
Aug 16 09:39:34 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37db3a-27b4-46e5-a5d1-bb080a079104 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaccded-a2a2-4a77-b1f6-b5e41ad437e1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== disconnect_volume: return (279ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:39:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Deleting instance files /opt/stack/data/nova/instances/33baf617-b569-4bc0-85a3-3f6611dcffdc_del
Aug 16 09:39:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Deletion of /opt/stack/data/nova/instances/33baf617-b569-4bc0-85a3-3f6611dcffdc_del complete
Aug 16 09:39:34 user nova-compute[73208]: INFO nova.compute.manager [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 16 09:39:34 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:39:34 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:39:35 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:39:35 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Took 1.29 seconds to deallocate network for instance.
Aug 16 09:39:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-13f73f64-b477-4d26-bbce-272426843583 req-8f2d4028-c7ff-490e-962c-075445d2ea36 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received event network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:39:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-13f73f64-b477-4d26-bbce-272426843583 req-8f2d4028-c7ff-490e-962c-075445d2ea36 service nova] Acquiring lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:39:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-13f73f64-b477-4d26-bbce-272426843583 req-8f2d4028-c7ff-490e-962c-075445d2ea36 service nova] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:39:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-13f73f64-b477-4d26-bbce-272426843583 req-8f2d4028-c7ff-490e-962c-075445d2ea36 service nova] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-13f73f64-b477-4d26-bbce-272426843583 req-8f2d4028-c7ff-490e-962c-075445d2ea36 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] No waiting events found dispatching network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:39:35 user nova-compute[73208]: WARNING nova.compute.manager [req-13f73f64-b477-4d26-bbce-272426843583 req-8f2d4028-c7ff-490e-962c-075445d2ea36 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received unexpected event network-vif-plugged-c7f48711-b3cb-4da5-a7fd-76aa3c269653 for instance with vm_state active and task_state deleting.
Aug 16 09:39:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-13f73f64-b477-4d26-bbce-272426843583 req-8f2d4028-c7ff-490e-962c-075445d2ea36 service nova] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Received event network-vif-deleted-c7f48711-b3cb-4da5-a7fd-76aa3c269653 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:39:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:36 user nova-compute[73208]: INFO nova.compute.manager [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Took 0.76 seconds to detach 1 volumes for instance.
Aug 16 09:39:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Deleting volume: 2a37db3a-27b4-46e5-a5d1-bb080a079104 {{(pid=73208) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 09:39:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:39:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:39:36 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:39:36 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:39:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:36 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Deleted allocations for instance 33baf617-b569-4bc0-85a3-3f6611dcffdc
Aug 16 09:39:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-8e1b2e4e-7dbd-41ee-90b0-3ecc928f1095 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "33baf617-b569-4bc0-85a3-3f6611dcffdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.726s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:38 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:39 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:39:40 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:39:40 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.20435333251953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:39:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:39:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:43 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:39:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:39:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:39:43 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:39:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:39:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:39:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:39:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:39:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:39:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:47 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:39:48 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692178773.7349777, 33baf617-b569-4bc0-85a3-3f6611dcffdc => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:39:48 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] VM Stopped (Lifecycle Event)
Aug 16 09:39:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-794e1da4-ef76-4262-95f2-d7a0396802ac None None] [instance: 33baf617-b569-4bc0-85a3-3f6611dcffdc] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:39:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:39:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:39:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:39:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:39:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:39:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:39:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:39:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:39:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:39:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:39:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:40:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:40:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:40:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:40:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:40:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:40:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:40:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=25.203258514404297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:40:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:40:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:40:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:40:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:40:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:40:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:40:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:40:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:40:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:40:44 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:40:45 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:40:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:40:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:40:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:40:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "8e82af63-b819-451f-9a24-fa90a81ae146" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:40:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "8e82af63-b819-451f-9a24-fa90a81ae146" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:40:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:40:47 user nova-compute[73208]: INFO nova.compute.claims [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Claim successful on node user
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:40:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:40:47 user nova-compute[73208]: INFO nova.virt.block_device [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Booting with volume 7d84e8b6-2158-4783-ad00-7835c7305494 at /dev/vda
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.policy [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae7839fe33794c6bb9c70f3005eab84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae086cfe405c4b9f80eef45ccae6d408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG os_brick.utils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d78e569-48d0-4a90-98d9-4243d63d579f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e577c-59f6-4215-b7f4-222c2b7156ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4f3f44-4506-4943-af32-fceba9d0b0d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[162fc47c-4f1e-493f-b47e-2cf594bd27ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:40:47 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:40:47 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc07860-6b4c-405c-91a9-ae247dd3dc19]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG os_brick.utils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:40:47 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Updating existing volume attachment record: b46e143e-5e0b-4742-bbdb-416d8527d168 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Successfully created port: 2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Successfully updated port: 2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquired lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-a5f16a0e-5a11-45ac-b9a7-98448e7463e7 req-ed1a3960-91c2-4f37-8d5d-167e468a6b23 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received event network-changed-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG nova.compute.manager [req-a5f16a0e-5a11-45ac-b9a7-98448e7463e7 req-ed1a3960-91c2-4f37-8d5d-167e468a6b23 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Refreshing instance network info cache due to event network-changed-2f10a8eb-e2d0-476b-96f1-c7fec649c87d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a5f16a0e-5a11-45ac-b9a7-98448e7463e7 req-ed1a3960-91c2-4f37-8d5d-167e468a6b23 service nova] Acquiring lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:40:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Updating instance_info_cache with network_info: [{"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Releasing lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Instance network_info: |[{"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a5f16a0e-5a11-45ac-b9a7-98448e7463e7 req-ed1a3960-91c2-4f37-8d5d-167e468a6b23 service nova] Acquired lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-a5f16a0e-5a11-45ac-b9a7-98448e7463e7 req-ed1a3960-91c2-4f37-8d5d-167e468a6b23 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Refreshing network info cache for port 2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'flavor' on Instance uuid 3253f62c-2ebf-4f53-bc64-91be81ed9d4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:40:49 user nova-compute[73208]: INFO nova.compute.manager [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Attaching volume 96ddec5d-073d-49c3-bd1f-cc12a7402464 to /dev/vdb
Aug 16 09:40:49 user nova-compute[73208]: DEBUG os_brick.utils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e329b64-4ffe-4e5d-ac90-b51a95c0ee49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3f45f-a5de-444f-8934-504129158f2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7262adc4-fc87-40a7-aa43-d441ebe138a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b466ee16-a904-497e-9524-77911a7521ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-a5f16a0e-5a11-45ac-b9a7-98448e7463e7 req-ed1a3960-91c2-4f37-8d5d-167e468a6b23 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Updated VIF entry in instance network info cache for port 2f10a8eb-e2d0-476b-96f1-c7fec649c87d. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG nova.network.neutron [req-a5f16a0e-5a11-45ac-b9a7-98448e7463e7 req-ed1a3960-91c2-4f37-8d5d-167e468a6b23 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Updating instance_info_cache with network_info: [{"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a5f16a0e-5a11-45ac-b9a7-98448e7463e7 req-ed1a3960-91c2-4f37-8d5d-167e468a6b23 service nova] Releasing lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:40:49 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:40:49 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4337edda-ac4b-433f-9e45-bb44c75ad442]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG os_brick.utils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:40:49 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating existing volume attachment record: 657eedac-f1cf-419e-9091-3e199bd26bb2 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:40:52 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:40:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:40:57 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Creating image(s)
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Ensure instance console log exists: /opt/stack/data/nova/instances/8e82af63-b819-451f-9a24-fa90a81ae146/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Start _get_guest_xml network_info=[{"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'b46e143e-5e0b-4742-bbdb-416d8527d168', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eulEbOAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e82af63-b819-451f-9a24-fa90a81ae146', 'attached_at': '', 'detached_at': '', 'volume_id': '7d84e8b6-2158-4783-ad00-7835c7305494', 'serial': '7d84e8b6-2158-4783-ad00-7835c7305494'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:40:57 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:40:57 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eulEbOAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:40:57 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:40:57 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:40:57 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0793db19-7e24-45ae-afe0-63435974badd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:40:57 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39d64c7-1eb5-43ce-9d21-0f984b88405d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494] added
Aug 16 09:40:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d82ce0-9e3b-4eb3-a22d-a5994410b2f9]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9557ec3f-1f89-46b1-8106-c7d251dde952]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eulEbOAI {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eulEbOAI" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e005f5-6f24-40e4-9a1b-3f6cb493c861]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eulEbOAI'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7925bd6f-2f3a-4e8d-8d33-08e620bda625]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[12133de4-0330-452f-954b-7611c5bb24c9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:40:57 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:40:57 user nova-compute[73208]:  {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:40:57 user nova-compute[73208]: WARNING os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 09:40:57 user nova-compute[73208]: 
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[683c1620-aefd-428a-a9f1-a63b8863636f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494, portal: 172.16.0.220,3260]
Aug 16 09:40:57 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494, portal: 172.16.0.220,3260] successful.
Aug 16 09:40:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b887f9b-14a3-432c-b49c-9e2ecafc9749]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7e6374-3e2e-47f4-b29f-d11771ea6343]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:40:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:40:57 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aaa010-0a62-415f-9535-8b4cb535c5e4]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:40:57 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eulEbOAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23632366562643965', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632366562643965', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1275193299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1275193299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1275193299',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiPpX/oUe6/MiSRy8rKyajl6wZWuSM127stBT7xaBBmvYoZV6b7S2wxTbgkJiZcOKwAborl0Ko0Wb/yvcoViEoabH4dEmUWFTAEUOgGsnzVhkgDFimwci9OuJmG6tYQeA==',key_name='tempest-keypair-1839982609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-vwomn6ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=8e82af63-b819-451f-9a24-fa90a81ae146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:76:40,bridge_name='br-int',has_traffic_filtering=True,id=2f10a8eb-e2d0-476b-96f1-c7fec649c87d,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f10a8eb-e2') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.objects.instance [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e82af63-b819-451f-9a24-fa90a81ae146 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:40:58 user nova-compute[73208]:   <uuid>8e82af63-b819-451f-9a24-fa90a81ae146</uuid>
Aug 16 09:40:58 user nova-compute[73208]:   <name>instance-0000002f</name>
Aug 16 09:40:58 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:40:58 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:40:58 user nova-compute[73208]:   <metadata>
Aug 16 09:40:58 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:40:58 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:40:58 user nova-compute[73208]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1275193299</nova:name>
Aug 16 09:40:58 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:40:57</nova:creationTime>
Aug 16 09:40:58 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:40:58 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:40:58 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:40:58 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:40:58 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:40:58 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:40:58 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:40:58 user nova-compute[73208]:       <nova:owner>
Aug 16 09:40:58 user nova-compute[73208]:         <nova:user uuid="ae7839fe33794c6bb9c70f3005eab84f">tempest-TestVolumeBootPattern-1567175042-project-member</nova:user>
Aug 16 09:40:58 user nova-compute[73208]:         <nova:project uuid="ae086cfe405c4b9f80eef45ccae6d408">tempest-TestVolumeBootPattern-1567175042</nova:project>
Aug 16 09:40:58 user nova-compute[73208]:       </nova:owner>
Aug 16 09:40:58 user nova-compute[73208]:       <nova:ports>
Aug 16 09:40:58 user nova-compute[73208]:         <nova:port uuid="2f10a8eb-e2d0-476b-96f1-c7fec649c87d">
Aug 16 09:40:58 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 09:40:58 user nova-compute[73208]:         </nova:port>
Aug 16 09:40:58 user nova-compute[73208]:       </nova:ports>
Aug 16 09:40:58 user nova-compute[73208]:     </nova:instance>
Aug 16 09:40:58 user nova-compute[73208]:   </metadata>
Aug 16 09:40:58 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:40:58 user nova-compute[73208]:     <system>
Aug 16 09:40:58 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:40:58 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:40:58 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:40:58 user nova-compute[73208]:       <entry name="serial">8e82af63-b819-451f-9a24-fa90a81ae146</entry>
Aug 16 09:40:58 user nova-compute[73208]:       <entry name="uuid">8e82af63-b819-451f-9a24-fa90a81ae146</entry>
Aug 16 09:40:58 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:40:58 user nova-compute[73208]:     </system>
Aug 16 09:40:58 user nova-compute[73208]:   </sysinfo>
Aug 16 09:40:58 user nova-compute[73208]:   <os>
Aug 16 09:40:58 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:40:58 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:40:58 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:40:58 user nova-compute[73208]:   </os>
Aug 16 09:40:58 user nova-compute[73208]:   <features>
Aug 16 09:40:58 user nova-compute[73208]:     <acpi/>
Aug 16 09:40:58 user nova-compute[73208]:     <apic/>
Aug 16 09:40:58 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:40:58 user nova-compute[73208]:   </features>
Aug 16 09:40:58 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:40:58 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:40:58 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:40:58 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:40:58 user nova-compute[73208]:   </clock>
Aug 16 09:40:58 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:40:58 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:40:58 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:40:58 user nova-compute[73208]:   </cpu>
Aug 16 09:40:58 user nova-compute[73208]:   <devices>
Aug 16 09:40:58 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:40:58 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:40:58 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:40:58 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:40:58 user nova-compute[73208]:       <serial>7d84e8b6-2158-4783-ad00-7835c7305494</serial>
Aug 16 09:40:58 user nova-compute[73208]:     </disk>
Aug 16 09:40:58 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:40:58 user nova-compute[73208]:       <mac address="fa:16:3e:14:76:40"/>
Aug 16 09:40:58 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:40:58 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:40:58 user nova-compute[73208]:       <target dev="tap2f10a8eb-e2"/>
Aug 16 09:40:58 user nova-compute[73208]:     </interface>
Aug 16 09:40:58 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:40:58 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/8e82af63-b819-451f-9a24-fa90a81ae146/console.log" append="off"/>
Aug 16 09:40:58 user nova-compute[73208]:     </serial>
Aug 16 09:40:58 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:40:58 user nova-compute[73208]:     <video>
Aug 16 09:40:58 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:40:58 user nova-compute[73208]:     </video>
Aug 16 09:40:58 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:40:58 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:40:58 user nova-compute[73208]:     </rng>
Aug 16 09:40:58 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:40:58 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:40:58 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:40:58 user nova-compute[73208]:     </memballoon>
Aug 16 09:40:58 user nova-compute[73208]:   </devices>
Aug 16 09:40:58 user nova-compute[73208]: </domain>
Aug 16 09:40:58 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1275193299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1275193299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1275193299',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiPpX/oUe6/MiSRy8rKyajl6wZWuSM127stBT7xaBBmvYoZV6b7S2wxTbgkJiZcOKwAborl0Ko0Wb/yvcoViEoabH4dEmUWFTAEUOgGsnzVhkgDFimwci9OuJmG6tYQeA==',key_name='tempest-keypair-1839982609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-vwomn6ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=8e82af63-b819-451f-9a24-fa90a81ae146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:76:40,bridge_name='br-int',has_traffic_filtering=True,id=2f10a8eb-e2d0-476b-96f1-c7fec649c87d,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f10a8eb-e2') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG os_vif [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:76:40,bridge_name='br-int',has_traffic_filtering=True,id=2f10a8eb-e2d0-476b-96f1-c7fec649c87d,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f10a8eb-e2') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f10a8eb-e2, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f10a8eb-e2, col_values=(('external_ids', {'iface-id': '2f10a8eb-e2d0-476b-96f1-c7fec649c87d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:76:40', 'vm-uuid': '8e82af63-b819-451f-9a24-fa90a81ae146'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:58 user nova-compute[73208]: INFO os_vif [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:76:40,bridge_name='br-int',has_traffic_filtering=True,id=2f10a8eb-e2d0-476b-96f1-c7fec649c87d,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f10a8eb-e2')
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:40:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No VIF found with MAC fa:16:3e:14:76:40, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJUjLTRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:40:59 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:40:59 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:40:59 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab0e0a7-1733-4c4f-bf5f-bf7ea438525d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:40:59 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a1537-46a9-499e-9cf9-7daa7212f213]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464] added
Aug 16 09:40:59 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad33f77-ccae-4a20-85b3-e119ecec1190]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d48aa5-3ea1-4ed9-bd6c-f0c403069bb0]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJUjLTRo {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJUjLTRo" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7798915c-22b5-4865-ac55-79e83e2b3604]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VJUjLTRo'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9f8b82-9889-49ed-9f9b-34d480d7e185]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ed0f8-0a8a-4c30-85a4-6f4b504139d6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:40:59 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:40:59 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[331306e4-37ad-4067-99a1-63f414c92c6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464, portal: 172.16.0.220,3260]
Aug 16 09:40:59 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464, portal: 172.16.0.220,3260] successful.
Aug 16 09:40:59 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7dde6-4092-4aa5-8648-b65141daf8ec]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d4e506-b503-4404-8b70-3b26a3e8ae10]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:40:59 user nova-compute[73208]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 (non-flash)
Aug 16 09:40:59 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:40:59 user nova-compute[73208]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 (non-flash)
Aug 16 09:40:59 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c4cabe-b4ce-448f-b585-20668b1515dd]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJUjLTRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:40:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-304d4571-c52d-4cc5-b135-09f687f948ab req-076ecea9-e8c1-4536-b430-47c481c0d31f service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received event network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-304d4571-c52d-4cc5-b135-09f687f948ab req-076ecea9-e8c1-4536-b430-47c481c0d31f service nova] Acquiring lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-304d4571-c52d-4cc5-b135-09f687f948ab req-076ecea9-e8c1-4536-b430-47c481c0d31f service nova] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-304d4571-c52d-4cc5-b135-09f687f948ab req-076ecea9-e8c1-4536-b430-47c481c0d31f service nova] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-304d4571-c52d-4cc5-b135-09f687f948ab req-076ecea9-e8c1-4536-b430-47c481c0d31f service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] No waiting events found dispatching network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:00 user nova-compute[73208]: WARNING nova.compute.manager [req-304d4571-c52d-4cc5-b135-09f687f948ab req-076ecea9-e8c1-4536-b430-47c481c0d31f service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received unexpected event network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d for instance with vm_state building and task_state spawning.
Aug 16 09:41:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26666633965316361', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666633965316361', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'flavor' on Instance uuid 3253f62c-2ebf-4f53-bc64-91be81ed9d4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:41:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:41:00 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:41:00 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:41:00 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:41:00 user nova-compute[73208]:   <serial>96ddec5d-073d-49c3-bd1f-cc12a7402464</serial>
Aug 16 09:41:00 user nova-compute[73208]: </disk>
Aug 16 09:41:00 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:41:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:41:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:41:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] No VIF found with MAC fa:16:3e:cb:c6:bf, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:41:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6d800036-9125-4331-905f-a1fb6d48e4c9 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.828s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178862.0568173, 8e82af63-b819-451f-9a24-fa90a81ae146 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:41:02 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] VM Resumed (Lifecycle Event)
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:41:02 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Instance spawned successfully.
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:41:02 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178862.0581357, 8e82af63-b819-451f-9a24-fa90a81ae146 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:41:02 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] VM Started (Lifecycle Event)
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:41:02 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:41:02 user nova-compute[73208]: INFO nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:02 user nova-compute[73208]: INFO nova.compute.manager [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Took 15.26 seconds to build instance.
Aug 16 09:41:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-2569900a-425c-42e9-b956-5c835c4d4ab8 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "8e82af63-b819-451f-9a24-fa90a81ae146" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.346s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-8358a867-d27b-48a0-91dc-9a0675a2faa8 req-2ab15a66-55a7-427b-9eb6-dd4de3570a8c service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received event network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8358a867-d27b-48a0-91dc-9a0675a2faa8 req-2ab15a66-55a7-427b-9eb6-dd4de3570a8c service nova] Acquiring lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8358a867-d27b-48a0-91dc-9a0675a2faa8 req-2ab15a66-55a7-427b-9eb6-dd4de3570a8c service nova] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8358a867-d27b-48a0-91dc-9a0675a2faa8 req-2ab15a66-55a7-427b-9eb6-dd4de3570a8c service nova] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:02 user nova-compute[73208]: DEBUG nova.compute.manager [req-8358a867-d27b-48a0-91dc-9a0675a2faa8 req-2ab15a66-55a7-427b-9eb6-dd4de3570a8c service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] No waiting events found dispatching network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:02 user nova-compute[73208]: WARNING nova.compute.manager [req-8358a867-d27b-48a0-91dc-9a0675a2faa8 req-2ab15a66-55a7-427b-9eb6-dd4de3570a8c service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received unexpected event network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d for instance with vm_state active and task_state None.
Aug 16 09:41:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-9ce730c1-cc6f-4c6b-a3a8-e0a2ab32ace2 req-14ce7439-a958-47a8-92a3-6ff57cae8ba2 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:04 user nova-compute[73208]: DEBUG nova.compute.manager [req-9ce730c1-cc6f-4c6b-a3a8-e0a2ab32ace2 req-14ce7439-a958-47a8-92a3-6ff57cae8ba2 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing instance network info cache due to event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:41:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9ce730c1-cc6f-4c6b-a3a8-e0a2ab32ace2 req-14ce7439-a958-47a8-92a3-6ff57cae8ba2 service nova] Acquiring lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:41:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9ce730c1-cc6f-4c6b-a3a8-e0a2ab32ace2 req-14ce7439-a958-47a8-92a3-6ff57cae8ba2 service nova] Acquired lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:41:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-9ce730c1-cc6f-4c6b-a3a8-e0a2ab32ace2 req-14ce7439-a958-47a8-92a3-6ff57cae8ba2 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:41:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-9ce730c1-cc6f-4c6b-a3a8-e0a2ab32ace2 req-14ce7439-a958-47a8-92a3-6ff57cae8ba2 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updated VIF entry in instance network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:41:04 user nova-compute[73208]: DEBUG nova.network.neutron [req-9ce730c1-cc6f-4c6b-a3a8-e0a2ab32ace2 req-14ce7439-a958-47a8-92a3-6ff57cae8ba2 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:41:04 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9ce730c1-cc6f-4c6b-a3a8-e0a2ab32ace2 req-14ce7439-a958-47a8-92a3-6ff57cae8ba2 service nova] Releasing lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:41:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG nova.compute.manager [req-25247c0d-4f94-4f46-bc8a-5fdf62abfdcf req-858bf337-bff6-4e7a-8a29-48887b72c315 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG nova.compute.manager [req-25247c0d-4f94-4f46-bc8a-5fdf62abfdcf req-858bf337-bff6-4e7a-8a29-48887b72c315 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing instance network info cache due to event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-25247c0d-4f94-4f46-bc8a-5fdf62abfdcf req-858bf337-bff6-4e7a-8a29-48887b72c315 service nova] Acquiring lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-25247c0d-4f94-4f46-bc8a-5fdf62abfdcf req-858bf337-bff6-4e7a-8a29-48887b72c315 service nova] Acquired lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-25247c0d-4f94-4f46-bc8a-5fdf62abfdcf req-858bf337-bff6-4e7a-8a29-48887b72c315 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:07 user nova-compute[73208]: INFO nova.compute.manager [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Rebooting instance
Aug 16 09:41:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-25247c0d-4f94-4f46-bc8a-5fdf62abfdcf req-858bf337-bff6-4e7a-8a29-48887b72c315 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updated VIF entry in instance network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG nova.network.neutron [req-25247c0d-4f94-4f46-bc8a-5fdf62abfdcf req-858bf337-bff6-4e7a-8a29-48887b72c315 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-25247c0d-4f94-4f46-bc8a-5fdf62abfdcf req-858bf337-bff6-4e7a-8a29-48887b72c315 service nova] Releasing lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquired lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:41:07 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:41:08 user nova-compute[73208]: DEBUG nova.network.neutron [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:41:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Releasing lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:41:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-10669ebb-1470-4384-b755-d14d14bdf782 req-9834e463-cb3e-47f2-9ba8-8ae2f9f4bd06 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-10669ebb-1470-4384-b755-d14d14bdf782 req-9834e463-cb3e-47f2-9ba8-8ae2f9f4bd06 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-10669ebb-1470-4384-b755-d14d14bdf782 req-9834e463-cb3e-47f2-9ba8-8ae2f9f4bd06 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-10669ebb-1470-4384-b755-d14d14bdf782 req-9834e463-cb3e-47f2-9ba8-8ae2f9f4bd06 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-10669ebb-1470-4384-b755-d14d14bdf782 req-9834e463-cb3e-47f2-9ba8-8ae2f9f4bd06 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:10 user nova-compute[73208]: WARNING nova.compute.manager [req-10669ebb-1470-4384-b755-d14d14bdf782 req-9834e463-cb3e-47f2-9ba8-8ae2f9f4bd06 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state reboot_started.
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Instance shutdown successfully.
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:12 user nova-compute[73208]: WARNING nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state reboot_started.
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:12 user nova-compute[73208]: WARNING nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state reboot_started.
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:12 user nova-compute[73208]: WARNING nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state reboot_started.
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:12 user nova-compute[73208]: WARNING nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state reboot_started.
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:12 user nova-compute[73208]: DEBUG nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:12 user nova-compute[73208]: WARNING nova.compute.manager [req-2e8b53ad-3b8d-492d-b2f3-35acdeddda8a req-20d317dd-b6cd-400d-ad3e-5e31bd6c5ea0 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state reboot_started.
Aug 16 09:41:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:14 user nova-compute[73208]: WARNING nova.compute.manager [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state reboot_started.
Aug 16 09:41:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:14 user nova-compute[73208]: DEBUG nova.compute.manager [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:14 user nova-compute[73208]: WARNING nova.compute.manager [req-00fb65cf-dc40-4026-b126-606bf027a3e7 req-2289eda4-612b-48bd-b5dc-c0597307cbc1 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state active and task_state reboot_started.
Aug 16 09:41:15 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for 3253f62c-2ebf-4f53-bc64-91be81ed9d4f due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:41:15 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178875.041142, 3253f62c-2ebf-4f53-bc64-91be81ed9d4f => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:41:15 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] VM Resumed (Lifecycle Event)
Aug 16 09:41:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Instance running successfully.
Aug 16 09:41:15 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Instance soft rebooted successfully.
Aug 16 09:41:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:41:15 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 09:41:15 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178875.0448291, 3253f62c-2ebf-4f53-bc64-91be81ed9d4f => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:41:15 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] VM Started (Lifecycle Event)
Aug 16 09:41:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:41:15 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-ca946186-5d00-4847-9b4c-18b377781bd3 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.486s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:32 user nova-compute[73208]: INFO nova.compute.manager [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Rescuing
Aug 16 09:41:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:41:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:41:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:41:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:41:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:41:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-9cce4c91-6c11-45f4-be72-4f99c2c22ece req-20c6af82-6662-4087-97ab-241a1a4c3ba6 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9cce4c91-6c11-45f4-be72-4f99c2c22ece req-20c6af82-6662-4087-97ab-241a1a4c3ba6 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9cce4c91-6c11-45f4-be72-4f99c2c22ece req-20c6af82-6662-4087-97ab-241a1a4c3ba6 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9cce4c91-6c11-45f4-be72-4f99c2c22ece req-20c6af82-6662-4087-97ab-241a1a4c3ba6 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-9cce4c91-6c11-45f4-be72-4f99c2c22ece req-20c6af82-6662-4087-97ab-241a1a4c3ba6 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:33 user nova-compute[73208]: WARNING nova.compute.manager [req-9cce4c91-6c11-45f4-be72-4f99c2c22ece req-20c6af82-6662-4087-97ab-241a1a4c3ba6 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state active and task_state rescuing.
Aug 16 09:41:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance destroyed successfully.
Aug 16 09:41:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Attempting rescue
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73208) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance directory exists: not creating {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 09:41:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Creating image(s)
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'trusted_certs' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue" returned: 0 in 0.061s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'migration_context' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Start _get_guest_xml network_info=[{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:b2:4c:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'resources' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'numa_topology' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:41:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:41:33 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'vcpu_model' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-176421415',display_name='tempest-ServerRescueNegativeTestJSON-server-176421415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-176421415',id=43,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:36:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-a019b11r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:36:55Z,user_data=None,user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=e54f2b10-5702-49c5-ab1a-da97d4a7ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:b2:4c:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:b2:4c:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=99199c52-a1ab-4001-b10e-51d2af388626,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99199c52-a1') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'pci_devices' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:41:33 user nova-compute[73208]:   <uuid>e54f2b10-5702-49c5-ab1a-da97d4a7ca05</uuid>
Aug 16 09:41:33 user nova-compute[73208]:   <name>instance-0000002b</name>
Aug 16 09:41:33 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:41:33 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:41:33 user nova-compute[73208]:   <metadata>
Aug 16 09:41:33 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:41:33 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:41:33 user nova-compute[73208]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-176421415</nova:name>
Aug 16 09:41:33 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:41:33</nova:creationTime>
Aug 16 09:41:33 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:41:33 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:41:33 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:41:33 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:41:33 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:41:33 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:41:33 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:41:33 user nova-compute[73208]:       <nova:owner>
Aug 16 09:41:33 user nova-compute[73208]:         <nova:user uuid="a1fe7fe8c35c42aeaf87cf3c4d4a37d8">tempest-ServerRescueNegativeTestJSON-1153173897-project-member</nova:user>
Aug 16 09:41:33 user nova-compute[73208]:         <nova:project uuid="9e197c75147746a282a02c61bba8ef65">tempest-ServerRescueNegativeTestJSON-1153173897</nova:project>
Aug 16 09:41:33 user nova-compute[73208]:       </nova:owner>
Aug 16 09:41:33 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:41:33 user nova-compute[73208]:       <nova:ports>
Aug 16 09:41:33 user nova-compute[73208]:         <nova:port uuid="99199c52-a1ab-4001-b10e-51d2af388626">
Aug 16 09:41:33 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 09:41:33 user nova-compute[73208]:         </nova:port>
Aug 16 09:41:33 user nova-compute[73208]:       </nova:ports>
Aug 16 09:41:33 user nova-compute[73208]:     </nova:instance>
Aug 16 09:41:33 user nova-compute[73208]:   </metadata>
Aug 16 09:41:33 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:41:33 user nova-compute[73208]:     <system>
Aug 16 09:41:33 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:41:33 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:41:33 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:41:33 user nova-compute[73208]:       <entry name="serial">e54f2b10-5702-49c5-ab1a-da97d4a7ca05</entry>
Aug 16 09:41:33 user nova-compute[73208]:       <entry name="uuid">e54f2b10-5702-49c5-ab1a-da97d4a7ca05</entry>
Aug 16 09:41:33 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:41:33 user nova-compute[73208]:     </system>
Aug 16 09:41:33 user nova-compute[73208]:   </sysinfo>
Aug 16 09:41:33 user nova-compute[73208]:   <os>
Aug 16 09:41:33 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:41:33 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:41:33 user nova-compute[73208]:   </os>
Aug 16 09:41:33 user nova-compute[73208]:   <features>
Aug 16 09:41:33 user nova-compute[73208]:     <acpi/>
Aug 16 09:41:33 user nova-compute[73208]:     <apic/>
Aug 16 09:41:33 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:41:33 user nova-compute[73208]:   </features>
Aug 16 09:41:33 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:41:33 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:41:33 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:41:33 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:41:33 user nova-compute[73208]:   </clock>
Aug 16 09:41:33 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:41:33 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:41:33 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:41:33 user nova-compute[73208]:   </cpu>
Aug 16 09:41:33 user nova-compute[73208]:   <devices>
Aug 16 09:41:33 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:41:33 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:41:33 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue"/>
Aug 16 09:41:33 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:41:33 user nova-compute[73208]:     </disk>
Aug 16 09:41:33 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:41:33 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:41:33 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk"/>
Aug 16 09:41:33 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:41:33 user nova-compute[73208]:     </disk>
Aug 16 09:41:33 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:41:33 user nova-compute[73208]:       <mac address="fa:16:3e:b2:4c:a3"/>
Aug 16 09:41:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:41:33 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:41:33 user nova-compute[73208]:       <target dev="tap99199c52-a1"/>
Aug 16 09:41:33 user nova-compute[73208]:     </interface>
Aug 16 09:41:33 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:41:33 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/console.log" append="off"/>
Aug 16 09:41:33 user nova-compute[73208]:     </serial>
Aug 16 09:41:33 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:41:33 user nova-compute[73208]:     <video>
Aug 16 09:41:33 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:41:33 user nova-compute[73208]:     </video>
Aug 16 09:41:33 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:41:33 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:41:33 user nova-compute[73208]:     </rng>
Aug 16 09:41:33 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:41:33 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:41:33 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:41:33 user nova-compute[73208]:     </memballoon>
Aug 16 09:41:33 user nova-compute[73208]:   </devices>
Aug 16 09:41:33 user nova-compute[73208]: </domain>
Aug 16 09:41:33 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance destroyed successfully.
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:41:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No VIF found with MAC fa:16:3e:b2:4c:a3, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-54e2001f-2de9-47b2-a8e6-3a5962ee9825 req-f2ffa0e9-527f-4516-be10-16756b3849c3 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-54e2001f-2de9-47b2-a8e6-3a5962ee9825 req-f2ffa0e9-527f-4516-be10-16756b3849c3 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-54e2001f-2de9-47b2-a8e6-3a5962ee9825 req-f2ffa0e9-527f-4516-be10-16756b3849c3 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-54e2001f-2de9-47b2-a8e6-3a5962ee9825 req-f2ffa0e9-527f-4516-be10-16756b3849c3 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG nova.compute.manager [req-54e2001f-2de9-47b2-a8e6-3a5962ee9825 req-f2ffa0e9-527f-4516-be10-16756b3849c3 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:35 user nova-compute[73208]: WARNING nova.compute.manager [req-54e2001f-2de9-47b2-a8e6-3a5962ee9825 req-f2ffa0e9-527f-4516-be10-16756b3849c3 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state active and task_state rescuing.
Aug 16 09:41:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:37 user nova-compute[73208]: WARNING nova.compute.manager [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state active and task_state rescuing.
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:41:37 user nova-compute[73208]: WARNING nova.compute.manager [req-3dea0701-2035-4c6d-a095-63c78685f576 req-bd07c2b8-57c7-4b8b-a8be-f1674ba22df0 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state active and task_state rescuing.
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for e54f2b10-5702-49c5-ab1a-da97d4a7ca05 due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178897.4152992, e54f2b10-5702-49c5-ab1a-da97d4a7ca05 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:41:37 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] VM Resumed (Lifecycle Event)
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6b74baf1-a4c4-4837-ad1c-a3db294edacc tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:41:37 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178897.4171925, e54f2b10-5702-49c5-ab1a-da97d4a7ca05 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:41:37 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] VM Started (Lifecycle Event)
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:41:37 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:41:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:41:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:40 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:41:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:41:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:41:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:41:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8355MB free_disk=25.19110870361328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8e82af63-b819-451f-9a24-fa90a81ae146 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:41:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:47 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:41:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:49 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:41:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:41:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Verify base images {{(pid=73208) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73208) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Image id 2193f7d5-cda9-4e7d-83d8-efeaad7cbb88 yields fingerprint 6e01b078924a3a735714c324a2d4cdcbf2d8c699 {{(pid=73208) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 09:42:10 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] image 2193f7d5-cda9-4e7d-83d8-efeaad7cbb88 at (/opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699): checking
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] image 2193f7d5-cda9-4e7d-83d8-efeaad7cbb88 at (/opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699): image is in use {{(pid=73208) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Image id 57e619ae-e236-4dcb-9810-c1a72d3e5cd4 yields fingerprint 9a5b7b85246924fc4d2c8ce6e563707aaad89484 {{(pid=73208) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 09:42:10 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] image 57e619ae-e236-4dcb-9810-c1a72d3e5cd4 at (/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484): checking
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] image 57e619ae-e236-4dcb-9810-c1a72d3e5cd4 at (/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484): image is in use {{(pid=73208) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] e54f2b10-5702-49c5-ab1a-da97d4a7ca05 is a valid instance name {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] e54f2b10-5702-49c5-ab1a-da97d4a7ca05 has a disk file {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 is backed by 9a5b7b85246924fc4d2c8ce6e563707aaad89484 {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] 9dd3d75b-db07-4907-854c-42278f817bb9 is a valid instance name {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] 9dd3d75b-db07-4907-854c-42278f817bb9 has a disk file {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 09:42:10 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 is backed by 9a5b7b85246924fc4d2c8ce6e563707aaad89484 {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] 3253f62c-2ebf-4f53-bc64-91be81ed9d4f is a valid instance name {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] 3253f62c-2ebf-4f53-bc64-91be81ed9d4f has a disk file {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f is backed by 6e01b078924a3a735714c324a2d4cdcbf2d8c699 {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] 8e82af63-b819-451f-9a24-fa90a81ae146 is a valid instance name {{(pid=73208) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 09:42:11 user nova-compute[73208]: WARNING nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Unknown base file: /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0
Aug 16 09:42:11 user nova-compute[73208]: WARNING nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Unknown base file: /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752
Aug 16 09:42:11 user nova-compute[73208]: WARNING nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Unknown base file: /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f
Aug 16 09:42:11 user nova-compute[73208]: WARNING nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Unknown base file: /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469
Aug 16 09:42:11 user nova-compute[73208]: WARNING nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Unknown base file: /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f
Aug 16 09:42:11 user nova-compute[73208]: WARNING nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Unknown base file: /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94
Aug 16 09:42:11 user nova-compute[73208]: WARNING nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Unknown base file: /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94
Aug 16 09:42:11 user nova-compute[73208]: WARNING nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Unknown base file: /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Active base files: /opt/stack/data/nova/instances/_base/6e01b078924a3a735714c324a2d4cdcbf2d8c699 /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Removable base files: /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0 /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752 /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469 /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94 /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94 /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dcd6105791e12a5760b1b7f69e47dcb68976a2a0
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a9c5ff2cc6cd4afbdcc3b416b6cc1616aaba5752
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a8874da7757b25abc7f6f39a0efb4a19c3324b3f
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e7b820dd8dd2419895dc62e094b14ed16ca01469
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/71d4ca6cbb22b057ac5ca8490922724758c7965f
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7b25a49874f8163ab80acc7b3b22a8e614e33c94
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7bd6fe0e16138ad2ee26f7a1fb8bd3cf6deada94
Aug 16 09:42:11 user nova-compute[73208]: INFO nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a820999ab0220465671fd40ff98e8f6365a2ac86
Aug 16 09:42:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Verification complete {{(pid=73208) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Verify swap images {{(pid=73208) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 09:42:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.imagecache [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Verify ephemeral images {{(pid=73208) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 09:42:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:42:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:42:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:42:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:42:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:42:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:42:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:42:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:42:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:42:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:42:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-7351e8e3-4017-4bd0-85a8-7bbde0053e91 req-c876908c-3b3f-4ce7-943f-e3bc9f193f2d service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received event network-changed-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-7351e8e3-4017-4bd0-85a8-7bbde0053e91 req-c876908c-3b3f-4ce7-943f-e3bc9f193f2d service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Refreshing instance network info cache due to event network-changed-2f10a8eb-e2d0-476b-96f1-c7fec649c87d. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7351e8e3-4017-4bd0-85a8-7bbde0053e91 req-c876908c-3b3f-4ce7-943f-e3bc9f193f2d service nova] Acquiring lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7351e8e3-4017-4bd0-85a8-7bbde0053e91 req-c876908c-3b3f-4ce7-943f-e3bc9f193f2d service nova] Acquired lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG nova.network.neutron [req-7351e8e3-4017-4bd0-85a8-7bbde0053e91 req-c876908c-3b3f-4ce7-943f-e3bc9f193f2d service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Refreshing network info cache for port 2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG nova.network.neutron [req-7351e8e3-4017-4bd0-85a8-7bbde0053e91 req-c876908c-3b3f-4ce7-943f-e3bc9f193f2d service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Updated VIF entry in instance network info cache for port 2f10a8eb-e2d0-476b-96f1-c7fec649c87d. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG nova.network.neutron [req-7351e8e3-4017-4bd0-85a8-7bbde0053e91 req-c876908c-3b3f-4ce7-943f-e3bc9f193f2d service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Updating instance_info_cache with network_info: [{"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5011 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7351e8e3-4017-4bd0-85a8-7bbde0053e91 req-c876908c-3b3f-4ce7-943f-e3bc9f193f2d service nova] Releasing lock "refresh_cache-8e82af63-b819-451f-9a24-fa90a81ae146" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:42:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:39 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:42:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:42:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:42:40 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:42:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8380MB free_disk=25.190021514892578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8e82af63-b819-451f-9a24-fa90a81ae146 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:42:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:42:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:42:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:42:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:42:45 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:42:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:46 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:42:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:42:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:42:47 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:42:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "a599405f-767d-4e25-964c-128431d13943" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:42:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "a599405f-767d-4e25-964c-128431d13943" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:42:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:42:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:42:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:42:49 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:42:49 user nova-compute[73208]: INFO nova.compute.claims [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Claim successful on node user
Aug 16 09:42:50 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:42:50 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:42:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:42:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:42:50 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:42:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:42:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:42:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:42:50 user nova-compute[73208]: INFO nova.virt.block_device [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Booting with volume snapshot aec8f07b-138d-4262-836b-0d30198ebd4b at /dev/vda
Aug 16 09:42:50 user nova-compute[73208]: DEBUG nova.policy [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae7839fe33794c6bb9c70f3005eab84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae086cfe405c4b9f80eef45ccae6d408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:42:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Successfully created port: d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:42:51 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Successfully updated port: d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquired lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-87c38dae-1ec2-4911-9138-9d26f2b63d15 req-d71dce33-61cd-4045-b2da-a2897f3ffe50 service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received event network-changed-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.compute.manager [req-87c38dae-1ec2-4911-9138-9d26f2b63d15 req-d71dce33-61cd-4045-b2da-a2897f3ffe50 service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Refreshing instance network info cache due to event network-changed-d9560c45-b741-43e2-b1a6-06a1587c69a8. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-87c38dae-1ec2-4911-9138-9d26f2b63d15 req-d71dce33-61cd-4045-b2da-a2897f3ffe50 service nova] Acquiring lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.network.neutron [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Updating instance_info_cache with network_info: [{"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Releasing lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Instance network_info: |[{"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-87c38dae-1ec2-4911-9138-9d26f2b63d15 req-d71dce33-61cd-4045-b2da-a2897f3ffe50 service nova] Acquired lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-87c38dae-1ec2-4911-9138-9d26f2b63d15 req-d71dce33-61cd-4045-b2da-a2897f3ffe50 service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Refreshing network info cache for port d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-87c38dae-1ec2-4911-9138-9d26f2b63d15 req-d71dce33-61cd-4045-b2da-a2897f3ffe50 service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Updated VIF entry in instance network info cache for port d9560c45-b741-43e2-b1a6-06a1587c69a8. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG nova.network.neutron [req-87c38dae-1ec2-4911-9138-9d26f2b63d15 req-d71dce33-61cd-4045-b2da-a2897f3ffe50 service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Updating instance_info_cache with network_info: [{"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:42:52 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-87c38dae-1ec2-4911-9138-9d26f2b63d15 req-d71dce33-61cd-4045-b2da-a2897f3ffe50 service nova] Releasing lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:42:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:42:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:42:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:42:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:42:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:42:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG os_brick.utils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ae725-425f-403b-a448-2be46993b352]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[524351df-6b67-4c36-9ba2-0b3022b46a55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe48f5-298d-4663-9eb5-3cd5b2caa70c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f667c93e-9b97-4201-980f-447052d5b2ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:42:56 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:42:56 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cb22ff-55fc-41d9-8dc2-c65852dd6cf0]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG os_brick.utils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Updating existing volume attachment record: 3d55c42e-5743-4871-ac38-4494b1e3e3de {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:42:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:42:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-0aee3dde-97f0-4eef-bb2d-01681763397f req-5a3535ee-8415-443a-8527-bc9403ed2c76 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:42:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-0aee3dde-97f0-4eef-bb2d-01681763397f req-5a3535ee-8415-443a-8527-bc9403ed2c76 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing instance network info cache due to event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:42:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0aee3dde-97f0-4eef-bb2d-01681763397f req-5a3535ee-8415-443a-8527-bc9403ed2c76 service nova] Acquiring lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:42:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0aee3dde-97f0-4eef-bb2d-01681763397f req-5a3535ee-8415-443a-8527-bc9403ed2c76 service nova] Acquired lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:42:59 user nova-compute[73208]: DEBUG nova.network.neutron [req-0aee3dde-97f0-4eef-bb2d-01681763397f req-5a3535ee-8415-443a-8527-bc9403ed2c76 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:42:59 user nova-compute[73208]: DEBUG nova.network.neutron [req-0aee3dde-97f0-4eef-bb2d-01681763397f req-5a3535ee-8415-443a-8527-bc9403ed2c76 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updated VIF entry in instance network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:42:59 user nova-compute[73208]: DEBUG nova.network.neutron [req-0aee3dde-97f0-4eef-bb2d-01681763397f req-5a3535ee-8415-443a-8527-bc9403ed2c76 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:42:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-0aee3dde-97f0-4eef-bb2d-01681763397f req-5a3535ee-8415-443a-8527-bc9403ed2c76 service nova] Releasing lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-612f8bd4-74d2-4351-9923-a938967d7fa1 req-71af4f00-ef49-41af-bdc7-3a05cd6d1181 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-612f8bd4-74d2-4351-9923-a938967d7fa1 req-71af4f00-ef49-41af-bdc7-3a05cd6d1181 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing instance network info cache due to event network-changed-8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-612f8bd4-74d2-4351-9923-a938967d7fa1 req-71af4f00-ef49-41af-bdc7-3a05cd6d1181 service nova] Acquiring lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-612f8bd4-74d2-4351-9923-a938967d7fa1 req-71af4f00-ef49-41af-bdc7-3a05cd6d1181 service nova] Acquired lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-612f8bd4-74d2-4351-9923-a938967d7fa1 req-71af4f00-ef49-41af-bdc7-3a05cd6d1181 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Refreshing network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:00 user nova-compute[73208]: INFO nova.compute.manager [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Detaching volume 96ddec5d-073d-49c3-bd1f-cc12a7402464
Aug 16 09:43:00 user nova-compute[73208]: INFO nova.virt.block_device [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Attempting to driver detach volume 96ddec5d-073d-49c3-bd1f-cc12a7402464 from mountpoint /dev/vdb
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Attempting to detach device vdb from instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:43:00 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:43:00 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:43:00 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:43:00 user nova-compute[73208]:   <serial>96ddec5d-073d-49c3-bd1f-cc12a7402464</serial>
Aug 16 09:43:00 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:43:00 user nova-compute[73208]: </disk>
Aug 16 09:43:00 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:43:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully detached device vdb from instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f from the persistent domain config.
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:43:00 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:43:00 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:43:00 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:43:00 user nova-compute[73208]:   <serial>96ddec5d-073d-49c3-bd1f-cc12a7402464</serial>
Aug 16 09:43:00 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:43:00 user nova-compute[73208]: </disk>
Aug 16 09:43:00 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-612f8bd4-74d2-4351-9923-a938967d7fa1 req-71af4f00-ef49-41af-bdc7-3a05cd6d1181 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updated VIF entry in instance network info cache for port 8b63cea2-cde7-4498-ba81-fc7574d80cc6. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG nova.network.neutron [req-612f8bd4-74d2-4351-9923-a938967d7fa1 req-71af4f00-ef49-41af-bdc7-3a05cd6d1181 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [{"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:43:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-612f8bd4-74d2-4351-9923-a938967d7fa1 req-71af4f00-ef49-41af-bdc7-3a05cd6d1181 service nova] Releasing lock "refresh_cache-3253f62c-2ebf-4f53-bc64-91be81ed9d4f" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692178981.0131743, 3253f62c-2ebf-4f53-bc64-91be81ed9d4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:43:01 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully detached device vdb from instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f from the live domain config.
Aug 16 09:43:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJUjLTRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:43:01 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb039fa-848f-4847-87b5-a273e4c9e164]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9646a743-9180-4a58-970d-afbde88a7064]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:43:01 user nova-compute[73208]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 (non-flash)
Aug 16 09:43:01 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:43:01 user nova-compute[73208]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 (non-flash)
Aug 16 09:43:01 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0662830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b37735-d3da-4a56-8d9f-1c13e289c1a6]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b4a55-6596-4c54-8687-24c54932ffd1]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[41639b0d-54d2-4d26-bd40-c5108f6f5082]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa65dc84-4be0-463a-a921-58f76fc03e7c]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bb0691-04e6-48a3-aaff-fae998d48fa4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c268a-b7c9-4e0f-9c81-d2c0004a0518]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464, portal: 172.16.0.220,3260]
Aug 16 09:43:01 user nova-compute[73208]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464, portal: 172.16.0.220,3260] successful.
Aug 16 09:43:01 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ddec5d-073d-49c3-bd1f-cc12a7402464 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce611f81-d762-4a82-9a71-2410e0938bd7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] <== disconnect_volume: return (264ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:43:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:02 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'flavor' on Instance uuid 3253f62c-2ebf-4f53-bc64-91be81ed9d4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:43:02 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a4d00475-f542-4697-b9e9-12b5b463ee77 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.601s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_power_states {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:03 user nova-compute[73208]: WARNING nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Aug 16 09:43:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 3253f62c-2ebf-4f53-bc64-91be81ed9d4f {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 8e82af63-b819-451f-9a24-fa90a81ae146 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid a599405f-767d-4e25-964c-128431d13943 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "9dd3d75b-db07-4907-854c-42278f817bb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "8e82af63-b819-451f-9a24-fa90a81ae146" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "8e82af63-b819-451f-9a24-fa90a81ae146" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "a599405f-767d-4e25-964c-128431d13943" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "9dd3d75b-db07-4907-854c-42278f817bb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "8e82af63-b819-451f-9a24-fa90a81ae146" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:05 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:05 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:43:05 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:43:06 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Creating image(s)
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Ensure instance console log exists: /opt/stack/data/nova/instances/a599405f-767d-4e25-964c-128431d13943/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Start _get_guest_xml network_info=[{"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T09:42:40Z,direct_url=<?>,disk_format='qcow2',id=3f0e4471-4d4b-45e2-8883-36e7efe367f9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-24374109',owner='ae086cfe405c4b9f80eef45ccae6d408',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T09:42:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '3d55c42e-5743-4871-ac38-4494b1e3e3de', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXYdsvQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a599405f-767d-4e25-964c-128431d13943', 'attached_at': '', 'detached_at': '', 'volume_id': '05456af9-5070-4636-a267-d12938224b0a', 'serial': '05456af9-5070-4636-a267-d12938224b0a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:43:06 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:43:06 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T09:42:40Z,direct_url=<?>,disk_format='qcow2',id=3f0e4471-4d4b-45e2-8883-36e7efe367f9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-24374109',owner='ae086cfe405c4b9f80eef45ccae6d408',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T09:42:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXYdsvQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:43:06 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:43:06 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:43:06 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca731009-ca2c-47d0-a22e-38ba3774feae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:43:06 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc577a-e9cb-45c9-aec7-72d5556dc4e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a] added
Aug 16 09:43:06 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0085f0db-4e2e-4ac6-813f-52ceaa72db17]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e6329c-e8ac-4a9a-8aca-8d7160f07d28]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXYdsvQP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXYdsvQP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[824f17fe-5337-4db8-b23e-7b8e284eb57f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lXYdsvQP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3a1704-4676-41c4-90ff-ed7826a790d5]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a506bfc4-a614-42a6-a772-91759aadae6c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:43:06 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:43:06 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc551d73-c760-4ed2-9c3e-991599dd141f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a, portal: 172.16.0.220,3260]
Aug 16 09:43:06 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a, portal: 172.16.0.220,3260] successful.
Aug 16 09:43:06 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a66b0-b9c8-469c-a57c-b18ffd74fa18]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa969bed-b818-4254-9266-92a44f136f05]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:43:06 user nova-compute[73208]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a (non-flash)
Aug 16 09:43:06 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:43:06 user nova-compute[73208]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a (non-flash)
Aug 16 09:43:06 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[23193dec-3be6-4889-bd6c-0fb95eab95a9]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:43:06 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXYdsvQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23038663134373337', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038663134373337', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1790026515',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1790026515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1790026515',id=48,image_ref='3f0e4471-4d4b-45e2-8883-36e7efe367f9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSgImk7wRedqQN7gXFinTqzOelbHjMqjCl79Ey867773sCVf+TeAbR+QE1EK/iVPJzD9VcHpNicwE43VJ8hg70OCXWUEzPl+KE+MVYxCwiwrJal+yduTBcBjE1qT/jnYA==',key_name='tempest-keypair-698687434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-hbre57kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1567175042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=a599405f-767d-4e25-964c-128431d13943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1b:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9560c45-b741-43e2-b1a6-06a1587c69a8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9560c45-b7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.objects.instance [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'pci_devices' on Instance uuid a599405f-767d-4e25-964c-128431d13943 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:43:07 user nova-compute[73208]:   <uuid>a599405f-767d-4e25-964c-128431d13943</uuid>
Aug 16 09:43:07 user nova-compute[73208]:   <name>instance-00000030</name>
Aug 16 09:43:07 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:43:07 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:43:07 user nova-compute[73208]:   <metadata>
Aug 16 09:43:07 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:43:07 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:43:07 user nova-compute[73208]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1790026515</nova:name>
Aug 16 09:43:07 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:43:06</nova:creationTime>
Aug 16 09:43:07 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:43:07 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:43:07 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:43:07 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:43:07 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:43:07 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:43:07 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:43:07 user nova-compute[73208]:       <nova:owner>
Aug 16 09:43:07 user nova-compute[73208]:         <nova:user uuid="ae7839fe33794c6bb9c70f3005eab84f">tempest-TestVolumeBootPattern-1567175042-project-member</nova:user>
Aug 16 09:43:07 user nova-compute[73208]:         <nova:project uuid="ae086cfe405c4b9f80eef45ccae6d408">tempest-TestVolumeBootPattern-1567175042</nova:project>
Aug 16 09:43:07 user nova-compute[73208]:       </nova:owner>
Aug 16 09:43:07 user nova-compute[73208]:       <nova:root type="image" uuid="3f0e4471-4d4b-45e2-8883-36e7efe367f9"/>
Aug 16 09:43:07 user nova-compute[73208]:       <nova:ports>
Aug 16 09:43:07 user nova-compute[73208]:         <nova:port uuid="d9560c45-b741-43e2-b1a6-06a1587c69a8">
Aug 16 09:43:07 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 09:43:07 user nova-compute[73208]:         </nova:port>
Aug 16 09:43:07 user nova-compute[73208]:       </nova:ports>
Aug 16 09:43:07 user nova-compute[73208]:     </nova:instance>
Aug 16 09:43:07 user nova-compute[73208]:   </metadata>
Aug 16 09:43:07 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:43:07 user nova-compute[73208]:     <system>
Aug 16 09:43:07 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:43:07 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:43:07 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:43:07 user nova-compute[73208]:       <entry name="serial">a599405f-767d-4e25-964c-128431d13943</entry>
Aug 16 09:43:07 user nova-compute[73208]:       <entry name="uuid">a599405f-767d-4e25-964c-128431d13943</entry>
Aug 16 09:43:07 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:43:07 user nova-compute[73208]:     </system>
Aug 16 09:43:07 user nova-compute[73208]:   </sysinfo>
Aug 16 09:43:07 user nova-compute[73208]:   <os>
Aug 16 09:43:07 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:43:07 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:43:07 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:43:07 user nova-compute[73208]:   </os>
Aug 16 09:43:07 user nova-compute[73208]:   <features>
Aug 16 09:43:07 user nova-compute[73208]:     <acpi/>
Aug 16 09:43:07 user nova-compute[73208]:     <apic/>
Aug 16 09:43:07 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:43:07 user nova-compute[73208]:   </features>
Aug 16 09:43:07 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:43:07 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:43:07 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:43:07 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:43:07 user nova-compute[73208]:   </clock>
Aug 16 09:43:07 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:43:07 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:43:07 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:43:07 user nova-compute[73208]:   </cpu>
Aug 16 09:43:07 user nova-compute[73208]:   <devices>
Aug 16 09:43:07 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:43:07 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:43:07 user nova-compute[73208]:       <source dev="/dev/sdc"/>
Aug 16 09:43:07 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:43:07 user nova-compute[73208]:       <serial>05456af9-5070-4636-a267-d12938224b0a</serial>
Aug 16 09:43:07 user nova-compute[73208]:     </disk>
Aug 16 09:43:07 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:43:07 user nova-compute[73208]:       <mac address="fa:16:3e:00:1b:c8"/>
Aug 16 09:43:07 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:43:07 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:43:07 user nova-compute[73208]:       <target dev="tapd9560c45-b7"/>
Aug 16 09:43:07 user nova-compute[73208]:     </interface>
Aug 16 09:43:07 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:43:07 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/a599405f-767d-4e25-964c-128431d13943/console.log" append="off"/>
Aug 16 09:43:07 user nova-compute[73208]:     </serial>
Aug 16 09:43:07 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:43:07 user nova-compute[73208]:     <video>
Aug 16 09:43:07 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:43:07 user nova-compute[73208]:     </video>
Aug 16 09:43:07 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:43:07 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:43:07 user nova-compute[73208]:     </rng>
Aug 16 09:43:07 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:43:07 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:43:07 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:43:07 user nova-compute[73208]:     </memballoon>
Aug 16 09:43:07 user nova-compute[73208]:   </devices>
Aug 16 09:43:07 user nova-compute[73208]: </domain>
Aug 16 09:43:07 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1790026515',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1790026515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1790026515',id=48,image_ref='3f0e4471-4d4b-45e2-8883-36e7efe367f9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSgImk7wRedqQN7gXFinTqzOelbHjMqjCl79Ey867773sCVf+TeAbR+QE1EK/iVPJzD9VcHpNicwE43VJ8hg70OCXWUEzPl+KE+MVYxCwiwrJal+yduTBcBjE1qT/jnYA==',key_name='tempest-keypair-698687434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-hbre57kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1567175042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=a599405f-767d-4e25-964c-128431d13943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1b:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9560c45-b741-43e2-b1a6-06a1587c69a8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9560c45-b7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG os_vif [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1b:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9560c45-b741-43e2-b1a6-06a1587c69a8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9560c45-b7') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9560c45-b7, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9560c45-b7, col_values=(('external_ids', {'iface-id': 'd9560c45-b741-43e2-b1a6-06a1587c69a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:1b:c8', 'vm-uuid': 'a599405f-767d-4e25-964c-128431d13943'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:07 user nova-compute[73208]: INFO os_vif [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1b:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9560c45-b741-43e2-b1a6-06a1587c69a8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9560c45-b7')
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:43:07 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No VIF found with MAC fa:16:3e:00:1b:c8, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:43:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-88a52e10-ace1-4dc6-95a2-1e3aa35b4ab5 req-7158935e-e1a0-4479-bb61-46a92cd4fbde service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received event network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-88a52e10-ace1-4dc6-95a2-1e3aa35b4ab5 req-7158935e-e1a0-4479-bb61-46a92cd4fbde service nova] Acquiring lock "a599405f-767d-4e25-964c-128431d13943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-88a52e10-ace1-4dc6-95a2-1e3aa35b4ab5 req-7158935e-e1a0-4479-bb61-46a92cd4fbde service nova] Lock "a599405f-767d-4e25-964c-128431d13943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-88a52e10-ace1-4dc6-95a2-1e3aa35b4ab5 req-7158935e-e1a0-4479-bb61-46a92cd4fbde service nova] Lock "a599405f-767d-4e25-964c-128431d13943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-88a52e10-ace1-4dc6-95a2-1e3aa35b4ab5 req-7158935e-e1a0-4479-bb61-46a92cd4fbde service nova] [instance: a599405f-767d-4e25-964c-128431d13943] No waiting events found dispatching network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:43:09 user nova-compute[73208]: WARNING nova.compute.manager [req-88a52e10-ace1-4dc6-95a2-1e3aa35b4ab5 req-7158935e-e1a0-4479-bb61-46a92cd4fbde service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received unexpected event network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 for instance with vm_state building and task_state spawning.
Aug 16 09:43:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178991.0250986, a599405f-767d-4e25-964c-128431d13943 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:43:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: a599405f-767d-4e25-964c-128431d13943] VM Resumed (Lifecycle Event)
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:43:11 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: a599405f-767d-4e25-964c-128431d13943] Instance spawned successfully.
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: a599405f-767d-4e25-964c-128431d13943] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: a599405f-767d-4e25-964c-128431d13943] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:43:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: a599405f-767d-4e25-964c-128431d13943] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692178991.027859, a599405f-767d-4e25-964c-128431d13943 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:43:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: a599405f-767d-4e25-964c-128431d13943] VM Started (Lifecycle Event)
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: a599405f-767d-4e25-964c-128431d13943] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: a599405f-767d-4e25-964c-128431d13943] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:43:11 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: a599405f-767d-4e25-964c-128431d13943] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:43:11 user nova-compute[73208]: INFO nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:43:11 user nova-compute[73208]: INFO nova.compute.manager [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Took 21.39 seconds to build instance.
Aug 16 09:43:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-d585c23a-dcc9-436d-9e11-5c7e21139484 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "a599405f-767d-4e25-964c-128431d13943" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.626s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "a599405f-767d-4e25-964c-128431d13943" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.816s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:11 user nova-compute[73208]: INFO nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: a599405f-767d-4e25-964c-128431d13943] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 16 09:43:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "a599405f-767d-4e25-964c-128431d13943" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-c2142515-2cdf-424a-acc5-090eab879a1c req-1756d7e9-ab9d-45f3-92b1-4d499cde6d7b service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received event network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c2142515-2cdf-424a-acc5-090eab879a1c req-1756d7e9-ab9d-45f3-92b1-4d499cde6d7b service nova] Acquiring lock "a599405f-767d-4e25-964c-128431d13943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c2142515-2cdf-424a-acc5-090eab879a1c req-1756d7e9-ab9d-45f3-92b1-4d499cde6d7b service nova] Lock "a599405f-767d-4e25-964c-128431d13943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c2142515-2cdf-424a-acc5-090eab879a1c req-1756d7e9-ab9d-45f3-92b1-4d499cde6d7b service nova] Lock "a599405f-767d-4e25-964c-128431d13943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-c2142515-2cdf-424a-acc5-090eab879a1c req-1756d7e9-ab9d-45f3-92b1-4d499cde6d7b service nova] [instance: a599405f-767d-4e25-964c-128431d13943] No waiting events found dispatching network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:43:11 user nova-compute[73208]: WARNING nova.compute.manager [req-c2142515-2cdf-424a-acc5-090eab879a1c req-1756d7e9-ab9d-45f3-92b1-4d499cde6d7b service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received unexpected event network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 for instance with vm_state active and task_state None.
Aug 16 09:43:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:43:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:23 user nova-compute[73208]: INFO nova.compute.manager [None req-58f7b9ed-b670-4400-acbd-ed58c10a5700 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Unrescuing
Aug 16 09:43:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-58f7b9ed-b670-4400-acbd-ed58c10a5700 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-58f7b9ed-b670-4400-acbd-ed58c10a5700 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG nova.network.neutron [None req-58f7b9ed-b670-4400-acbd-ed58c10a5700 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG nova.network.neutron [None req-58f7b9ed-b670-4400-acbd-ed58c10a5700 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-58f7b9ed-b670-4400-acbd-ed58c10a5700 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG nova.objects.instance [None req-58f7b9ed-b670-4400-acbd-ed58c10a5700 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'flavor' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-fba222f9-ed3c-4578-a888-b1854fbd279d req-d0099b6d-fa88-4bbe-a1a6-bdeae8d7e56b service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fba222f9-ed3c-4578-a888-b1854fbd279d req-d0099b6d-fa88-4bbe-a1a6-bdeae8d7e56b service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fba222f9-ed3c-4578-a888-b1854fbd279d req-d0099b6d-fa88-4bbe-a1a6-bdeae8d7e56b service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fba222f9-ed3c-4578-a888-b1854fbd279d req-d0099b6d-fa88-4bbe-a1a6-bdeae8d7e56b service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-fba222f9-ed3c-4578-a888-b1854fbd279d req-d0099b6d-fa88-4bbe-a1a6-bdeae8d7e56b service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:43:23 user nova-compute[73208]: WARNING nova.compute.manager [req-fba222f9-ed3c-4578-a888-b1854fbd279d req-d0099b6d-fa88-4bbe-a1a6-bdeae8d7e56b service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:43:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:24 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance destroyed successfully.
Aug 16 09:43:24 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:43:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:43:25 user nova-compute[73208]: WARNING nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:43:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:43:25 user nova-compute[73208]: WARNING nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:43:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:43:25 user nova-compute[73208]: WARNING nova.compute.manager [req-e437bf68-b8e6-49b7-9613-ceaee70cc837 req-ba3ca2ce-3923-4500-bbe5-e1edeae1ca55 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:43:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:27 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for e54f2b10-5702-49c5-ab1a-da97d4a7ca05 due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:43:27 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179007.5551271, e54f2b10-5702-49c5-ab1a-da97d4a7ca05 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:43:27 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] VM Resumed (Lifecycle Event)
Aug 16 09:43:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-58f7b9ed-b670-4400-acbd-ed58c10a5700 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:43:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:43:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:43:27 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 09:43:27 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179007.5565717, e54f2b10-5702-49c5-ab1a-da97d4a7ca05 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:43:27 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] VM Started (Lifecycle Event)
Aug 16 09:43:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:43:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:43:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:38 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:43:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:43:43 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8236MB free_disk=25.18741226196289GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8e82af63-b819-451f-9a24-fa90a81ae146 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance a599405f-767d-4e25-964c-128431d13943 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:43:43 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:43:44 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:43:44 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:43:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:43:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:43:45 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:43:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:43:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:43:45 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:43:45 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:43:46 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:43:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:43:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:43:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:49 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:43:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:52 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:43:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:57 user nova-compute[73208]: INFO nova.compute.manager [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Terminating instance
Aug 16 09:43:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-f8b35177-2571-451f-8f21-fc31deddb407 req-94383b5f-7173-4ec6-8ea0-35bc7fe78430 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f8b35177-2571-451f-8f21-fc31deddb407 req-94383b5f-7173-4ec6-8ea0-35bc7fe78430 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f8b35177-2571-451f-8f21-fc31deddb407 req-94383b5f-7173-4ec6-8ea0-35bc7fe78430 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f8b35177-2571-451f-8f21-fc31deddb407 req-94383b5f-7173-4ec6-8ea0-35bc7fe78430 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-f8b35177-2571-451f-8f21-fc31deddb407 req-94383b5f-7173-4ec6-8ea0-35bc7fe78430 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG nova.compute.manager [req-f8b35177-2571-451f-8f21-fc31deddb407 req-94383b5f-7173-4ec6-8ea0-35bc7fe78430 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-unplugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:57 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Instance destroyed successfully.
Aug 16 09:43:57 user nova-compute[73208]: DEBUG nova.objects.instance [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lazy-loading 'resources' on Instance uuid 3253f62c-2ebf-4f53-bc64-91be81ed9d4f {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-554114254',display_name='tempest-TestMinimumBasicScenario-server-554114254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-554114254',id=46,image_ref='2193f7d5-cda9-4e7d-83d8-efeaad7cbb88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUJlEIByCvHxbgBIB/n+Sm44qxiwXxP38mvKJL/1BRFxrf3Xwr778wtmFc/B3ypb+rBnt8ki2m49+SHJbI2G+1JQsKycRO9RQAy0huMl6QGZ7u8FKQXyXSWx6RPi5W8dw==',key_name='tempest-TestMinimumBasicScenario-826566296',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:39:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b0176f0acf145c799a0ec1fbdc2fef7',ramdisk_id='',reservation_id='r-7revain1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2193f7d5-cda9-4e7d-83d8-efeaad7cbb88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1791382392',owner_user_name='tempest-TestMinimumBasicScenario-1791382392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:41:15Z,user_data=None,user_id='8c8d33aff1c142f0b93dbfe203ca040f',uuid=3253f62c-2ebf-4f53-bc64-91be81ed9d4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converting VIF {"id": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "address": "fa:16:3e:cb:c6:bf", "network": {"id": "00eb7bde-8889-4fee-b227-64240a2f001a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1910459840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b0176f0acf145c799a0ec1fbdc2fef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b63cea2-cd", "ovs_interfaceid": "8b63cea2-cde7-4498-ba81-fc7574d80cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:c6:bf,bridge_name='br-int',has_traffic_filtering=True,id=8b63cea2-cde7-4498-ba81-fc7574d80cc6,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b63cea2-cd') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG os_vif [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:c6:bf,bridge_name='br-int',has_traffic_filtering=True,id=8b63cea2-cde7-4498-ba81-fc7574d80cc6,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b63cea2-cd') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b63cea2-cd, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:43:58 user nova-compute[73208]: INFO os_vif [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:c6:bf,bridge_name='br-int',has_traffic_filtering=True,id=8b63cea2-cde7-4498-ba81-fc7574d80cc6,network=Network(00eb7bde-8889-4fee-b227-64240a2f001a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b63cea2-cd')
Aug 16 09:43:58 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Deleting instance files /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f_del
Aug 16 09:43:58 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Deletion of /opt/stack/data/nova/instances/3253f62c-2ebf-4f53-bc64-91be81ed9d4f_del complete
Aug 16 09:43:58 user nova-compute[73208]: INFO nova.compute.manager [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 16 09:43:58 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:43:58 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:43:59 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Took 0.92 seconds to deallocate network for instance.
Aug 16 09:43:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:59 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Deleted allocations for instance 3253f62c-2ebf-4f53-bc64-91be81ed9d4f
Aug 16 09:43:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-237b4bf3-b904-4faa-854b-9cc6b7ba0db1 tempest-TestMinimumBasicScenario-1791382392 tempest-TestMinimumBasicScenario-1791382392-project-member] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.145s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-ecaccbd1-b547-4b10-bab9-65366374eb24 req-40101740-2d2f-44f9-a930-ad912e83dac9 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ecaccbd1-b547-4b10-bab9-65366374eb24 req-40101740-2d2f-44f9-a930-ad912e83dac9 service nova] Acquiring lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ecaccbd1-b547-4b10-bab9-65366374eb24 req-40101740-2d2f-44f9-a930-ad912e83dac9 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ecaccbd1-b547-4b10-bab9-65366374eb24 req-40101740-2d2f-44f9-a930-ad912e83dac9 service nova] Lock "3253f62c-2ebf-4f53-bc64-91be81ed9d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:43:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-ecaccbd1-b547-4b10-bab9-65366374eb24 req-40101740-2d2f-44f9-a930-ad912e83dac9 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] No waiting events found dispatching network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:43:59 user nova-compute[73208]: WARNING nova.compute.manager [req-ecaccbd1-b547-4b10-bab9-65366374eb24 req-40101740-2d2f-44f9-a930-ad912e83dac9 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received unexpected event network-vif-plugged-8b63cea2-cde7-4498-ba81-fc7574d80cc6 for instance with vm_state deleted and task_state None.
Aug 16 09:43:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-ecaccbd1-b547-4b10-bab9-65366374eb24 req-40101740-2d2f-44f9-a930-ad912e83dac9 service nova] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Received event network-vif-deleted-8b63cea2-cde7-4498-ba81-fc7574d80cc6 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:44:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:44:12 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179037.9890845, 3253f62c-2ebf-4f53-bc64-91be81ed9d4f => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:44:12 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] VM Stopped (Lifecycle Event)
Aug 16 09:44:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-682e09a0-a6fe-4489-abc6-43b395d68949 None None] [instance: 3253f62c-2ebf-4f53-bc64-91be81ed9d4f] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:44:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:44:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:44:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:44:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:44:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:44:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:44:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:44:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:44:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-be5cb965-6785-48a2-95c9-56ddc71f9672 req-e66b896a-aa83-4575-a92e-9be16bd0baec service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received event network-changed-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-be5cb965-6785-48a2-95c9-56ddc71f9672 req-e66b896a-aa83-4575-a92e-9be16bd0baec service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Refreshing instance network info cache due to event network-changed-d9560c45-b741-43e2-b1a6-06a1587c69a8. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-be5cb965-6785-48a2-95c9-56ddc71f9672 req-e66b896a-aa83-4575-a92e-9be16bd0baec service nova] Acquiring lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-be5cb965-6785-48a2-95c9-56ddc71f9672 req-e66b896a-aa83-4575-a92e-9be16bd0baec service nova] Acquired lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-be5cb965-6785-48a2-95c9-56ddc71f9672 req-e66b896a-aa83-4575-a92e-9be16bd0baec service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Refreshing network info cache for port d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-be5cb965-6785-48a2-95c9-56ddc71f9672 req-e66b896a-aa83-4575-a92e-9be16bd0baec service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Updated VIF entry in instance network info cache for port d9560c45-b741-43e2-b1a6-06a1587c69a8. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG nova.network.neutron [req-be5cb965-6785-48a2-95c9-56ddc71f9672 req-e66b896a-aa83-4575-a92e-9be16bd0baec service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Updating instance_info_cache with network_info: [{"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:44:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-be5cb965-6785-48a2-95c9-56ddc71f9672 req-e66b896a-aa83-4575-a92e-9be16bd0baec service nova] Releasing lock "refresh_cache-a599405f-767d-4e25-964c-128431d13943" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "a599405f-767d-4e25-964c-128431d13943" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "a599405f-767d-4e25-964c-128431d13943" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "a599405f-767d-4e25-964c-128431d13943-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "a599405f-767d-4e25-964c-128431d13943-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "a599405f-767d-4e25-964c-128431d13943-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:44:41 user nova-compute[73208]: INFO nova.compute.manager [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Terminating instance
Aug 16 09:44:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: a599405f-767d-4e25-964c-128431d13943] Instance destroyed successfully.
Aug 16 09:44:41 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'resources' on Instance uuid a599405f-767d-4e25-964c-128431d13943 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1790026515',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1790026515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1790026515',id=48,image_ref='3f0e4471-4d4b-45e2-8883-36e7efe367f9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSgImk7wRedqQN7gXFinTqzOelbHjMqjCl79Ey867773sCVf+TeAbR+QE1EK/iVPJzD9VcHpNicwE43VJ8hg70OCXWUEzPl+KE+MVYxCwiwrJal+yduTBcBjE1qT/jnYA==',key_name='tempest-keypair-698687434',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:43:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-hbre57kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1567175042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=a599405f-767d-4e25-964c-128431d13943,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "address": "fa:16:3e:00:1b:c8", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9560c45-b7", "ovs_interfaceid": "d9560c45-b741-43e2-b1a6-06a1587c69a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:1b:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9560c45-b741-43e2-b1a6-06a1587c69a8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9560c45-b7') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_vif [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1b:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9560c45-b741-43e2-b1a6-06a1587c69a8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9560c45-b7') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9560c45-b7, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:44:41 user nova-compute[73208]: INFO os_vif [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1b:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9560c45-b741-43e2-b1a6-06a1587c69a8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9560c45-b7')
Aug 16 09:44:41 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXYdsvQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:44:41 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d916d1-7ef9-4ff0-9e1b-229d1a6531cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f755085a-e6e0-47d4-b740-93e0cfb393fe]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:44:41 user nova-compute[73208]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a (non-flash)
Aug 16 09:44:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:44:41 user nova-compute[73208]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a (non-flash)
Aug 16 09:44:41 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0107880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd7f2c6-cb7b-47a1-9568-81ed2e387d20]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0d6f68-317f-4e60-b348-5e652df615a7]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2494ce81-2d75-47e8-9280-d14027cfff88]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:44:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ae5e55-fe19-45b4-a834-003756feb9cd]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_37cf8b52', '/dev/disk/by-id/scsi-1SCST_BIO37cf8b52-08f14737446bf8f7', '/dev/disk/by-id/scsi-23038663134373337') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ef934-5a59-422b-b8f1-caa61be1cc39]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f02feda-0cac-4a1a-961e-78949d8e803f]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3776fa-016b-4784-8a77-b7e24194884b]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a, portal: 172.16.0.220,3260]
Aug 16 09:44:42 user nova-compute[73208]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a, portal: 172.16.0.220,3260] successful.
Aug 16 09:44:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05456af9-5070-4636-a267-d12938224b0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcbd0fe-3817-4e70-8d44-b46a00a232f0]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== disconnect_volume: return (290ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:44:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Deleting instance files /opt/stack/data/nova/instances/a599405f-767d-4e25-964c-128431d13943_del
Aug 16 09:44:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Deletion of /opt/stack/data/nova/instances/a599405f-767d-4e25-964c-128431d13943_del complete
Aug 16 09:44:42 user nova-compute[73208]: INFO nova.compute.manager [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: a599405f-767d-4e25-964c-128431d13943] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: a599405f-767d-4e25-964c-128431d13943] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received event network-vif-unplugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] Acquiring lock "a599405f-767d-4e25-964c-128431d13943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] Lock "a599405f-767d-4e25-964c-128431d13943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] Lock "a599405f-767d-4e25-964c-128431d13943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] [instance: a599405f-767d-4e25-964c-128431d13943] No waiting events found dispatching network-vif-unplugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received event network-vif-unplugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received event network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] Acquiring lock "a599405f-767d-4e25-964c-128431d13943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] Lock "a599405f-767d-4e25-964c-128431d13943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] Lock "a599405f-767d-4e25-964c-128431d13943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] [instance: a599405f-767d-4e25-964c-128431d13943] No waiting events found dispatching network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:44:42 user nova-compute[73208]: WARNING nova.compute.manager [req-fa544e62-a7d2-44a5-ba7c-2ee4cef41082 req-4d2a83f7-c83a-467e-a9e0-74d5f99573cc service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received unexpected event network-vif-plugged-d9560c45-b741-43e2-b1a6-06a1587c69a8 for instance with vm_state active and task_state deleting.
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: a599405f-767d-4e25-964c-128431d13943] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:44:42 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: a599405f-767d-4e25-964c-128431d13943] Took 0.71 seconds to deallocate network for instance.
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:43 user nova-compute[73208]: INFO nova.compute.manager [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Took 0.81 seconds to detach 1 volumes for instance.
Aug 16 09:44:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: a599405f-767d-4e25-964c-128431d13943] Deleting volume: 05456af9-5070-4636-a267-d12938224b0a {{(pid=73208) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:44:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:44:44 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:44:44 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8463MB free_disk=25.21422576904297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:44:44 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Deleted allocations for instance a599405f-767d-4e25-964c-128431d13943
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 8e82af63-b819-451f-9a24-fa90a81ae146 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.manager [req-77f207d6-9c47-437b-92cf-0a7d042a4efb req-7b7f254a-a41e-49f4-9154-8f4c687e90a6 service nova] [instance: a599405f-767d-4e25-964c-128431d13943] Received event network-vif-deleted-d9560c45-b741-43e2-b1a6-06a1587c69a8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3a60bfbc-7aa7-4084-a7f1-9322ee166232 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "a599405f-767d-4e25-964c-128431d13943" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.518s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:44:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:44:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:46 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:44:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:44:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:44:46 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:44:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:47 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:44:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:44:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:44:47 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:51 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:52 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:44:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:44:55 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:44:56 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179081.8015473, a599405f-767d-4e25-964c-128431d13943 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:44:56 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: a599405f-767d-4e25-964c-128431d13943] VM Stopped (Lifecycle Event)
Aug 16 09:44:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-33a1db2f-ceab-45c9-8938-9c059a6fac75 None None] [instance: a599405f-767d-4e25-964c-128431d13943] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:44:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:19 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:45:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:19 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:45:20 user nova-compute[73208]: INFO nova.compute.claims [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Claim successful on node user
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:45:20 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.policy [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1fe7fe8c35c42aeaf87cf3c4d4a37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e197c75147746a282a02c61bba8ef65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:45:20 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Creating image(s)
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk 1073741824 {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk 1073741824" returned: 0 in 0.055s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:20 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk. size=1073741824 {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Successfully created port: e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.virt.disk.api [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Cannot resize image /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk to a smaller size. {{(pid=73208) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.objects.instance [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'migration_context' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Ensure instance console log exists: /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Successfully updated port: e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-91be4a77-efea-47b8-ae97-94cbd2204530 req-a71be416-ff36-43a7-9264-3b827bcb0218 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-changed-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.compute.manager [req-91be4a77-efea-47b8-ae97-94cbd2204530 req-a71be416-ff36-43a7-9264-3b827bcb0218 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Refreshing instance network info cache due to event network-changed-e8498fd0-804d-40cc-9ad5-3bf025666824. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-91be4a77-efea-47b8-ae97-94cbd2204530 req-a71be416-ff36-43a7-9264-3b827bcb0218 service nova] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:45:21 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.network.neutron [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance network_info: |[{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-91be4a77-efea-47b8-ae97-94cbd2204530 req-a71be416-ff36-43a7-9264-3b827bcb0218 service nova] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.network.neutron [req-91be4a77-efea-47b8-ae97-94cbd2204530 req-a71be416-ff36-43a7-9264-3b827bcb0218 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Refreshing network info cache for port e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Start _get_guest_xml network_info=[{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:45:22 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:45:22 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-268411743',display_name='tempest-ServerRescueNegativeTestJSON-server-268411743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-268411743',id=49,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAQzI8HEzk24A2xbzNXmAbNOg+HQtK1HQ1z355r6nO/ApLxwPlqbiukbUWpdEwi2gGODux3ryrZGTb/NmlaPO8o2WiJuvU6z0XcndSLjMM6AwB4tmrEWblna7vdS9dJvg==',key_name='tempest-keypair-1686473256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-1x8vua74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=e3d52f21-689c-4b81-9f47-a98d822b0efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=e8498fd0-804d-40cc-9ad5-3bf025666824,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8498fd0-80') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.objects.instance [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'pci_devices' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:45:22 user nova-compute[73208]:   <uuid>e3d52f21-689c-4b81-9f47-a98d822b0efe</uuid>
Aug 16 09:45:22 user nova-compute[73208]:   <name>instance-00000031</name>
Aug 16 09:45:22 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:45:22 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:45:22 user nova-compute[73208]:   <metadata>
Aug 16 09:45:22 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:45:22 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:45:22 user nova-compute[73208]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-268411743</nova:name>
Aug 16 09:45:22 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:45:22</nova:creationTime>
Aug 16 09:45:22 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:45:22 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:45:22 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:45:22 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:45:22 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:45:22 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:45:22 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:45:22 user nova-compute[73208]:       <nova:owner>
Aug 16 09:45:22 user nova-compute[73208]:         <nova:user uuid="a1fe7fe8c35c42aeaf87cf3c4d4a37d8">tempest-ServerRescueNegativeTestJSON-1153173897-project-member</nova:user>
Aug 16 09:45:22 user nova-compute[73208]:         <nova:project uuid="9e197c75147746a282a02c61bba8ef65">tempest-ServerRescueNegativeTestJSON-1153173897</nova:project>
Aug 16 09:45:22 user nova-compute[73208]:       </nova:owner>
Aug 16 09:45:22 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:45:22 user nova-compute[73208]:       <nova:ports>
Aug 16 09:45:22 user nova-compute[73208]:         <nova:port uuid="e8498fd0-804d-40cc-9ad5-3bf025666824">
Aug 16 09:45:22 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 09:45:22 user nova-compute[73208]:         </nova:port>
Aug 16 09:45:22 user nova-compute[73208]:       </nova:ports>
Aug 16 09:45:22 user nova-compute[73208]:     </nova:instance>
Aug 16 09:45:22 user nova-compute[73208]:   </metadata>
Aug 16 09:45:22 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:45:22 user nova-compute[73208]:     <system>
Aug 16 09:45:22 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:45:22 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:45:22 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:45:22 user nova-compute[73208]:       <entry name="serial">e3d52f21-689c-4b81-9f47-a98d822b0efe</entry>
Aug 16 09:45:22 user nova-compute[73208]:       <entry name="uuid">e3d52f21-689c-4b81-9f47-a98d822b0efe</entry>
Aug 16 09:45:22 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:45:22 user nova-compute[73208]:     </system>
Aug 16 09:45:22 user nova-compute[73208]:   </sysinfo>
Aug 16 09:45:22 user nova-compute[73208]:   <os>
Aug 16 09:45:22 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:45:22 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:45:22 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:45:22 user nova-compute[73208]:   </os>
Aug 16 09:45:22 user nova-compute[73208]:   <features>
Aug 16 09:45:22 user nova-compute[73208]:     <acpi/>
Aug 16 09:45:22 user nova-compute[73208]:     <apic/>
Aug 16 09:45:22 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:45:22 user nova-compute[73208]:   </features>
Aug 16 09:45:22 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:45:22 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:45:22 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:45:22 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:45:22 user nova-compute[73208]:   </clock>
Aug 16 09:45:22 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:45:22 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:45:22 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:45:22 user nova-compute[73208]:   </cpu>
Aug 16 09:45:22 user nova-compute[73208]:   <devices>
Aug 16 09:45:22 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:45:22 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:45:22 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk"/>
Aug 16 09:45:22 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:45:22 user nova-compute[73208]:     </disk>
Aug 16 09:45:22 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:45:22 user nova-compute[73208]:       <mac address="fa:16:3e:0c:47:f9"/>
Aug 16 09:45:22 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:45:22 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:45:22 user nova-compute[73208]:       <target dev="tape8498fd0-80"/>
Aug 16 09:45:22 user nova-compute[73208]:     </interface>
Aug 16 09:45:22 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:45:22 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/console.log" append="off"/>
Aug 16 09:45:22 user nova-compute[73208]:     </serial>
Aug 16 09:45:22 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:45:22 user nova-compute[73208]:     <video>
Aug 16 09:45:22 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:45:22 user nova-compute[73208]:     </video>
Aug 16 09:45:22 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:45:22 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:45:22 user nova-compute[73208]:     </rng>
Aug 16 09:45:22 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:45:22 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:45:22 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:45:22 user nova-compute[73208]:     </memballoon>
Aug 16 09:45:22 user nova-compute[73208]:   </devices>
Aug 16 09:45:22 user nova-compute[73208]: </domain>
Aug 16 09:45:22 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-268411743',display_name='tempest-ServerRescueNegativeTestJSON-server-268411743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-268411743',id=49,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAQzI8HEzk24A2xbzNXmAbNOg+HQtK1HQ1z355r6nO/ApLxwPlqbiukbUWpdEwi2gGODux3ryrZGTb/NmlaPO8o2WiJuvU6z0XcndSLjMM6AwB4tmrEWblna7vdS9dJvg==',key_name='tempest-keypair-1686473256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-1x8vua74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=e3d52f21-689c-4b81-9f47-a98d822b0efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=e8498fd0-804d-40cc-9ad5-3bf025666824,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8498fd0-80') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG os_vif [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=e8498fd0-804d-40cc-9ad5-3bf025666824,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8498fd0-80') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8498fd0-80, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8498fd0-80, col_values=(('external_ids', {'iface-id': 'e8498fd0-804d-40cc-9ad5-3bf025666824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:47:f9', 'vm-uuid': 'e3d52f21-689c-4b81-9f47-a98d822b0efe'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:22 user nova-compute[73208]: INFO os_vif [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=e8498fd0-804d-40cc-9ad5-3bf025666824,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8498fd0-80')
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:45:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No VIF found with MAC fa:16:3e:0c:47:f9, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG nova.network.neutron [req-91be4a77-efea-47b8-ae97-94cbd2204530 req-a71be416-ff36-43a7-9264-3b827bcb0218 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updated VIF entry in instance network info cache for port e8498fd0-804d-40cc-9ad5-3bf025666824. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG nova.network.neutron [req-91be4a77-efea-47b8-ae97-94cbd2204530 req-a71be416-ff36-43a7-9264-3b827bcb0218 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-91be4a77-efea-47b8-ae97-94cbd2204530 req-a71be416-ff36-43a7-9264-3b827bcb0218 service nova] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-58cdd151-5146-4d31-b3b4-9cf1da7aca8a req-29c25732-b307-42e7-841f-b5f32d8d6dd2 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-58cdd151-5146-4d31-b3b4-9cf1da7aca8a req-29c25732-b307-42e7-841f-b5f32d8d6dd2 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-58cdd151-5146-4d31-b3b4-9cf1da7aca8a req-29c25732-b307-42e7-841f-b5f32d8d6dd2 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-58cdd151-5146-4d31-b3b4-9cf1da7aca8a req-29c25732-b307-42e7-841f-b5f32d8d6dd2 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-58cdd151-5146-4d31-b3b4-9cf1da7aca8a req-29c25732-b307-42e7-841f-b5f32d8d6dd2 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:45:23 user nova-compute[73208]: WARNING nova.compute.manager [req-58cdd151-5146-4d31-b3b4-9cf1da7aca8a req-29c25732-b307-42e7-841f-b5f32d8d6dd2 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state building and task_state spawning.
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179125.8145838, e3d52f21-689c-4b81-9f47-a98d822b0efe => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:45:25 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] VM Resumed (Lifecycle Event)
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:45:25 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance spawned successfully.
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:45:25 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179125.816322, e3d52f21-689c-4b81-9f47-a98d822b0efe => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:45:25 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] VM Started (Lifecycle Event)
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:45:25 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:45:25 user nova-compute[73208]: INFO nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 16 09:45:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:45:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-fb823d22-0482-45cb-869c-7aad75e2bb26 req-84f360b8-2ba8-4d20-88e7-410f9dcc5df6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:45:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fb823d22-0482-45cb-869c-7aad75e2bb26 req-84f360b8-2ba8-4d20-88e7-410f9dcc5df6 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fb823d22-0482-45cb-869c-7aad75e2bb26 req-84f360b8-2ba8-4d20-88e7-410f9dcc5df6 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-fb823d22-0482-45cb-869c-7aad75e2bb26 req-84f360b8-2ba8-4d20-88e7-410f9dcc5df6 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:26 user nova-compute[73208]: DEBUG nova.compute.manager [req-fb823d22-0482-45cb-869c-7aad75e2bb26 req-84f360b8-2ba8-4d20-88e7-410f9dcc5df6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:45:26 user nova-compute[73208]: WARNING nova.compute.manager [req-fb823d22-0482-45cb-869c-7aad75e2bb26 req-84f360b8-2ba8-4d20-88e7-410f9dcc5df6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state active and task_state None.
Aug 16 09:45:26 user nova-compute[73208]: INFO nova.compute.manager [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Took 6.05 seconds to build instance.
Aug 16 09:45:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-e309d4d4-a6ab-4672-9bbe-5cff62df109c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.144s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "8e82af63-b819-451f-9a24-fa90a81ae146" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "8e82af63-b819-451f-9a24-fa90a81ae146" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:36 user nova-compute[73208]: INFO nova.compute.manager [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Terminating instance
Aug 16 09:45:36 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-61d188c5-81c8-4768-8302-c77271e5283e req-f308ee26-6220-4f19-8cdc-203ed5c875f5 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received event network-vif-unplugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-61d188c5-81c8-4768-8302-c77271e5283e req-f308ee26-6220-4f19-8cdc-203ed5c875f5 service nova] Acquiring lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-61d188c5-81c8-4768-8302-c77271e5283e req-f308ee26-6220-4f19-8cdc-203ed5c875f5 service nova] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-61d188c5-81c8-4768-8302-c77271e5283e req-f308ee26-6220-4f19-8cdc-203ed5c875f5 service nova] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-61d188c5-81c8-4768-8302-c77271e5283e req-f308ee26-6220-4f19-8cdc-203ed5c875f5 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] No waiting events found dispatching network-vif-unplugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.compute.manager [req-61d188c5-81c8-4768-8302-c77271e5283e req-f308ee26-6220-4f19-8cdc-203ed5c875f5 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received event network-vif-unplugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Instance destroyed successfully.
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'resources' on Instance uuid 8e82af63-b819-451f-9a24-fa90a81ae146 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1275193299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1275193299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1275193299',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiPpX/oUe6/MiSRy8rKyajl6wZWuSM127stBT7xaBBmvYoZV6b7S2wxTbgkJiZcOKwAborl0Ko0Wb/yvcoViEoabH4dEmUWFTAEUOgGsnzVhkgDFimwci9OuJmG6tYQeA==',key_name='tempest-keypair-1839982609',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:41:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-vwomn6ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=8e82af63-b819-451f-9a24-fa90a81ae146,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "address": "fa:16:3e:14:76:40", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f10a8eb-e2", "ovs_interfaceid": "2f10a8eb-e2d0-476b-96f1-c7fec649c87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:76:40,bridge_name='br-int',has_traffic_filtering=True,id=2f10a8eb-e2d0-476b-96f1-c7fec649c87d,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f10a8eb-e2') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_vif [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:76:40,bridge_name='br-int',has_traffic_filtering=True,id=2f10a8eb-e2d0-476b-96f1-c7fec649c87d,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f10a8eb-e2') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f10a8eb-e2, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:45:37 user nova-compute[73208]: INFO os_vif [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:76:40,bridge_name='br-int',has_traffic_filtering=True,id=2f10a8eb-e2d0-476b-96f1-c7fec649c87d,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f10a8eb-e2')
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eulEbOAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:45:37 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4ddc55-d07b-4b1b-8bdf-2ee57dac9269]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bf0234-bd7d-470f-8073-2fee38a08872]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:45:37 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 (non-flash)
Aug 16 09:45:37 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6f01fb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4588861f-976b-4240-a8dc-4cc30b87d1b0]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a575e1f7-4d25-4706-ad3a-4a2c684e35be]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[239d5861-4830-4643-a86b-5ed1579c1345]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9240be77-536c-462b-8d40-1677dea62282]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa6877b7f-626ebd9eb4a6bdfb', '/dev/disk/by-id/scsi-23632366562643965', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a6877b7f') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c44f5e-2c5b-4015-a37a-a03841d9b435]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da921f9-e3d4-4153-b35b-c2067a951a80]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b06826-b733-4b8f-aca7-0e819ab22042]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494, portal: 172.16.0.220,3260]
Aug 16 09:45:37 user nova-compute[73208]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494, portal: 172.16.0.220,3260] successful.
Aug 16 09:45:37 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d84e8b6-2158-4783-ad00-7835c7305494 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317c004-5d01-4a11-ba46-d3f1facfa062]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== disconnect_volume: return (275ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:45:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Deleting instance files /opt/stack/data/nova/instances/8e82af63-b819-451f-9a24-fa90a81ae146_del
Aug 16 09:45:37 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Deletion of /opt/stack/data/nova/instances/8e82af63-b819-451f-9a24-fa90a81ae146_del complete
Aug 16 09:45:37 user nova-compute[73208]: INFO nova.compute.manager [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 16 09:45:37 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:45:37 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-c114ddfc-83d5-4dba-8538-cb15c2cbe769 req-05ff5a54-266b-4c7d-a82b-bf9706102576 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received event network-vif-deleted-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:45:39 user nova-compute[73208]: INFO nova.compute.manager [req-c114ddfc-83d5-4dba-8538-cb15c2cbe769 req-05ff5a54-266b-4c7d-a82b-bf9706102576 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Neutron deleted interface 2f10a8eb-e2d0-476b-96f1-c7fec649c87d; detaching it from the instance and deleting it from the info cache
Aug 16 09:45:39 user nova-compute[73208]: DEBUG nova.network.neutron [req-c114ddfc-83d5-4dba-8538-cb15c2cbe769 req-05ff5a54-266b-4c7d-a82b-bf9706102576 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-c114ddfc-83d5-4dba-8538-cb15c2cbe769 req-05ff5a54-266b-4c7d-a82b-bf9706102576 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Detach interface failed, port_id=2f10a8eb-e2d0-476b-96f1-c7fec649c87d, reason: Instance 8e82af63-b819-451f-9a24-fa90a81ae146 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:45:39 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Took 1.09 seconds to deallocate network for instance.
Aug 16 09:45:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-3ad848aa-3143-45c7-8780-4fcdf516963e req-4a643596-83c4-4f53-a65d-c782eb2a6c44 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received event network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3ad848aa-3143-45c7-8780-4fcdf516963e req-4a643596-83c4-4f53-a65d-c782eb2a6c44 service nova] Acquiring lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3ad848aa-3143-45c7-8780-4fcdf516963e req-4a643596-83c4-4f53-a65d-c782eb2a6c44 service nova] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-3ad848aa-3143-45c7-8780-4fcdf516963e req-4a643596-83c4-4f53-a65d-c782eb2a6c44 service nova] Lock "8e82af63-b819-451f-9a24-fa90a81ae146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG nova.compute.manager [req-3ad848aa-3143-45c7-8780-4fcdf516963e req-4a643596-83c4-4f53-a65d-c782eb2a6c44 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] No waiting events found dispatching network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:45:39 user nova-compute[73208]: WARNING nova.compute.manager [req-3ad848aa-3143-45c7-8780-4fcdf516963e req-4a643596-83c4-4f53-a65d-c782eb2a6c44 service nova] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Received unexpected event network-vif-plugged-2f10a8eb-e2d0-476b-96f1-c7fec649c87d for instance with vm_state active and task_state deleting.
Aug 16 09:45:39 user nova-compute[73208]: INFO nova.compute.manager [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 09:45:39 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Deleting volume: 7d84e8b6-2158-4783-ad00-7835c7305494 {{(pid=73208) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:39 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:40 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:45:40 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:45:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:40 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Deleted allocations for instance 8e82af63-b819-451f-9a24-fa90a81ae146
Aug 16 09:45:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-a8475814-5f81-4303-aa39-3108bd93cddc tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "8e82af63-b819-451f-9a24-fa90a81ae146" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.391s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:40 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:43 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:45:45 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:45:45 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:45:45 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=25.225265502929688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e3d52f21-689c-4b81-9f47-a98d822b0efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:45:45 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:45:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:45:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:45:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:45:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:45:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:51 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:52 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179137.5514822, 8e82af63-b819-451f-9a24-fa90a81ae146 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:45:52 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] VM Stopped (Lifecycle Event)
Aug 16 09:45:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f2e74b0e-64c0-48b9-ad45-0de4af401014 None None] [instance: 8e82af63-b819-451f-9a24-fa90a81ae146] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:45:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:52 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:52 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:45:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:45:56 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:45:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:46:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:46:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:46:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:46:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:46:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:46:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:46:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:46:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:46:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "2df41dca-5906-4222-8202-c310f79b2c93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "2df41dca-5906-4222-8202-c310f79b2c93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:46:40 user nova-compute[73208]: INFO nova.compute.claims [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Claim successful on node user
Aug 16 09:46:40 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:46:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:46:41 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:46:41 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:46:41 user nova-compute[73208]: INFO nova.virt.block_device [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Booting with volume fe049d2b-4779-4365-9ae8-b22de023b39d at /dev/vda
Aug 16 09:46:41 user nova-compute[73208]: DEBUG nova.policy [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae7839fe33794c6bb9c70f3005eab84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae086cfe405c4b9f80eef45ccae6d408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG os_brick.utils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebaf48f-a3d5-4fb3-b7fd-bd3f3efdfebb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[16055804-042e-4d27-8fd9-595ff20103c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a6fb84-06b0-426f-b57a-5b0bb976f653]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a150f30-6bc3-4598-a4a6-5496fd5d8d92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:46:41 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:46:41 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0106259f-ce26-469d-9e3f-5056650dda95]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG os_brick.utils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Updating existing volume attachment record: 6ae97a7b-9623-4429-9a1b-97c286ffc8fa {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:46:41 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Successfully created port: be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Successfully updated port: be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquired lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-5bf1ee2f-7722-4e66-9f59-8f31edcbdc7a req-fdf1401a-7157-462e-9053-be3f25420a41 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received event network-changed-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG nova.compute.manager [req-5bf1ee2f-7722-4e66-9f59-8f31edcbdc7a req-fdf1401a-7157-462e-9053-be3f25420a41 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Refreshing instance network info cache due to event network-changed-be24d861-f555-416f-ba04-4ad5dd382810. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5bf1ee2f-7722-4e66-9f59-8f31edcbdc7a req-fdf1401a-7157-462e-9053-be3f25420a41 service nova] Acquiring lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG nova.network.neutron [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Updating instance_info_cache with network_info: [{"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Releasing lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Instance network_info: |[{"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5bf1ee2f-7722-4e66-9f59-8f31edcbdc7a req-fdf1401a-7157-462e-9053-be3f25420a41 service nova] Acquired lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:46:42 user nova-compute[73208]: DEBUG nova.network.neutron [req-5bf1ee2f-7722-4e66-9f59-8f31edcbdc7a req-fdf1401a-7157-462e-9053-be3f25420a41 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Refreshing network info cache for port be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:46:43 user nova-compute[73208]: DEBUG nova.network.neutron [req-5bf1ee2f-7722-4e66-9f59-8f31edcbdc7a req-fdf1401a-7157-462e-9053-be3f25420a41 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Updated VIF entry in instance network info cache for port be24d861-f555-416f-ba04-4ad5dd382810. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:46:43 user nova-compute[73208]: DEBUG nova.network.neutron [req-5bf1ee2f-7722-4e66-9f59-8f31edcbdc7a req-fdf1401a-7157-462e-9053-be3f25420a41 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Updating instance_info_cache with network_info: [{"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:46:43 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5bf1ee2f-7722-4e66-9f59-8f31edcbdc7a req-fdf1401a-7157-462e-9053-be3f25420a41 service nova] Releasing lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:46:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:46:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:46:44 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:46:44 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:46:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:44 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:46 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:46:46 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:46:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=25.222061157226562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e3d52f21-689c-4b81-9f47-a98d822b0efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 2df41dca-5906-4222-8202-c310f79b2c93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:46:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:46:47 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:46:47 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:46:47 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:46:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:46:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Skipping network cache update for instance because it is Building. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:46:48 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:46:49 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:46:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:46:49 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:46:49 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:46:51 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Creating image(s)
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Ensure instance console log exists: /opt/stack/data/nova/instances/2df41dca-5906-4222-8202-c310f79b2c93/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Start _get_guest_xml network_info=[{"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6ae97a7b-9623-4429-9a1b-97c286ffc8fa', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHUMSaYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2df41dca-5906-4222-8202-c310f79b2c93', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe049d2b-4779-4365-9ae8-b22de023b39d', 'serial': 'fe049d2b-4779-4365-9ae8-b22de023b39d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:46:51 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:46:51 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHUMSaYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:46:51 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:46:51 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:46:51 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3eb9b3-a817-4c68-95ca-0c3fd742ba1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:46:51 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9339a5-1739-490a-97d6-a8b403983ba0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d] added
Aug 16 09:46:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e216b33b-b12b-4687-b8b3-7cd52bc15884]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8528c8-d4e6-484f-a3f1-9ca1b8fa1382]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHUMSaYI {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHUMSaYI" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6c7caa-f908-4fc5-8caa-c53c2718e837]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eHUMSaYI'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc632ac-5d4f-4e93-8e26-bfed3115d798]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d594df-e164-40a6-a837-eebbcd6b2217]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:46:51 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 09:46:51 user nova-compute[73208]:  {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:46:51 user nova-compute[73208]: WARNING os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 09:46:51 user nova-compute[73208]: 
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b522f133-edd8-4b3c-bf5b-f359277bb318]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260]
Aug 16 09:46:51 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260] successful.
Aug 16 09:46:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9e8ccc-8acc-4a44-b4c9-70ce207eb098]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4005cbee-4a09-4625-a6fb-c2d4120bf238]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:46:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:46:51 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb9acb6-83c9-42e3-8272-5ac564fd4257]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:46:51 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHUMSaYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23763633936623062', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763633936623062', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-215832511',display_name='tempest-TestVolumeBootPattern-server-215832511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-215832511',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-srlj35xr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:46:41Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=2df41dca-5906-4222-8202-c310f79b2c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6b:c7,bridge_name='br-int',has_traffic_filtering=True,id=be24d861-f555-416f-ba04-4ad5dd382810,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24d861-f5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.objects.instance [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'pci_devices' on Instance uuid 2df41dca-5906-4222-8202-c310f79b2c93 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:46:52 user nova-compute[73208]:   <uuid>2df41dca-5906-4222-8202-c310f79b2c93</uuid>
Aug 16 09:46:52 user nova-compute[73208]:   <name>instance-00000032</name>
Aug 16 09:46:52 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:46:52 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:46:52 user nova-compute[73208]:   <metadata>
Aug 16 09:46:52 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:46:52 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:46:52 user nova-compute[73208]:       <nova:name>tempest-TestVolumeBootPattern-server-215832511</nova:name>
Aug 16 09:46:52 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:46:51</nova:creationTime>
Aug 16 09:46:52 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:46:52 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:46:52 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:46:52 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:46:52 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:46:52 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:46:52 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:46:52 user nova-compute[73208]:       <nova:owner>
Aug 16 09:46:52 user nova-compute[73208]:         <nova:user uuid="ae7839fe33794c6bb9c70f3005eab84f">tempest-TestVolumeBootPattern-1567175042-project-member</nova:user>
Aug 16 09:46:52 user nova-compute[73208]:         <nova:project uuid="ae086cfe405c4b9f80eef45ccae6d408">tempest-TestVolumeBootPattern-1567175042</nova:project>
Aug 16 09:46:52 user nova-compute[73208]:       </nova:owner>
Aug 16 09:46:52 user nova-compute[73208]:       <nova:ports>
Aug 16 09:46:52 user nova-compute[73208]:         <nova:port uuid="be24d861-f555-416f-ba04-4ad5dd382810">
Aug 16 09:46:52 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 09:46:52 user nova-compute[73208]:         </nova:port>
Aug 16 09:46:52 user nova-compute[73208]:       </nova:ports>
Aug 16 09:46:52 user nova-compute[73208]:     </nova:instance>
Aug 16 09:46:52 user nova-compute[73208]:   </metadata>
Aug 16 09:46:52 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:46:52 user nova-compute[73208]:     <system>
Aug 16 09:46:52 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:46:52 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:46:52 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:46:52 user nova-compute[73208]:       <entry name="serial">2df41dca-5906-4222-8202-c310f79b2c93</entry>
Aug 16 09:46:52 user nova-compute[73208]:       <entry name="uuid">2df41dca-5906-4222-8202-c310f79b2c93</entry>
Aug 16 09:46:52 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:46:52 user nova-compute[73208]:     </system>
Aug 16 09:46:52 user nova-compute[73208]:   </sysinfo>
Aug 16 09:46:52 user nova-compute[73208]:   <os>
Aug 16 09:46:52 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:46:52 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:46:52 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:46:52 user nova-compute[73208]:   </os>
Aug 16 09:46:52 user nova-compute[73208]:   <features>
Aug 16 09:46:52 user nova-compute[73208]:     <acpi/>
Aug 16 09:46:52 user nova-compute[73208]:     <apic/>
Aug 16 09:46:52 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:46:52 user nova-compute[73208]:   </features>
Aug 16 09:46:52 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:46:52 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:46:52 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:46:52 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:46:52 user nova-compute[73208]:   </clock>
Aug 16 09:46:52 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:46:52 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:46:52 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:46:52 user nova-compute[73208]:   </cpu>
Aug 16 09:46:52 user nova-compute[73208]:   <devices>
Aug 16 09:46:52 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:46:52 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:46:52 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:46:52 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:46:52 user nova-compute[73208]:       <serial>fe049d2b-4779-4365-9ae8-b22de023b39d</serial>
Aug 16 09:46:52 user nova-compute[73208]:     </disk>
Aug 16 09:46:52 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:46:52 user nova-compute[73208]:       <mac address="fa:16:3e:f7:6b:c7"/>
Aug 16 09:46:52 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:46:52 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:46:52 user nova-compute[73208]:       <target dev="tapbe24d861-f5"/>
Aug 16 09:46:52 user nova-compute[73208]:     </interface>
Aug 16 09:46:52 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:46:52 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/2df41dca-5906-4222-8202-c310f79b2c93/console.log" append="off"/>
Aug 16 09:46:52 user nova-compute[73208]:     </serial>
Aug 16 09:46:52 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:46:52 user nova-compute[73208]:     <video>
Aug 16 09:46:52 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:46:52 user nova-compute[73208]:     </video>
Aug 16 09:46:52 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:46:52 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:46:52 user nova-compute[73208]:     </rng>
Aug 16 09:46:52 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:46:52 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:46:52 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:46:52 user nova-compute[73208]:     </memballoon>
Aug 16 09:46:52 user nova-compute[73208]:   </devices>
Aug 16 09:46:52 user nova-compute[73208]: </domain>
Aug 16 09:46:52 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-215832511',display_name='tempest-TestVolumeBootPattern-server-215832511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-215832511',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-srlj35xr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:46:41Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=2df41dca-5906-4222-8202-c310f79b2c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6b:c7,bridge_name='br-int',has_traffic_filtering=True,id=be24d861-f555-416f-ba04-4ad5dd382810,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24d861-f5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG os_vif [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6b:c7,bridge_name='br-int',has_traffic_filtering=True,id=be24d861-f555-416f-ba04-4ad5dd382810,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24d861-f5') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe24d861-f5, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe24d861-f5, col_values=(('external_ids', {'iface-id': 'be24d861-f555-416f-ba04-4ad5dd382810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:6b:c7', 'vm-uuid': '2df41dca-5906-4222-8202-c310f79b2c93'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:52 user nova-compute[73208]: INFO os_vif [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6b:c7,bridge_name='br-int',has_traffic_filtering=True,id=be24d861-f555-416f-ba04-4ad5dd382810,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24d861-f5')
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:46:52 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No VIF found with MAC fa:16:3e:f7:6b:c7, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:46:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:46:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-c02b1f6b-01bb-41a7-8127-8b03e4b864dc req-1f0f3178-7d4c-4f63-9de6-f6b261800b91 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received event network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c02b1f6b-01bb-41a7-8127-8b03e4b864dc req-1f0f3178-7d4c-4f63-9de6-f6b261800b91 service nova] Acquiring lock "2df41dca-5906-4222-8202-c310f79b2c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c02b1f6b-01bb-41a7-8127-8b03e4b864dc req-1f0f3178-7d4c-4f63-9de6-f6b261800b91 service nova] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c02b1f6b-01bb-41a7-8127-8b03e4b864dc req-1f0f3178-7d4c-4f63-9de6-f6b261800b91 service nova] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG nova.compute.manager [req-c02b1f6b-01bb-41a7-8127-8b03e4b864dc req-1f0f3178-7d4c-4f63-9de6-f6b261800b91 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] No waiting events found dispatching network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:46:54 user nova-compute[73208]: WARNING nova.compute.manager [req-c02b1f6b-01bb-41a7-8127-8b03e4b864dc req-1f0f3178-7d4c-4f63-9de6-f6b261800b91 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received unexpected event network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 for instance with vm_state building and task_state spawning.
Aug 16 09:46:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:54 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179216.1045675, 2df41dca-5906-4222-8202-c310f79b2c93 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:46:56 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] VM Resumed (Lifecycle Event)
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:46:56 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Instance spawned successfully.
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:46:56 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179216.106023, 2df41dca-5906-4222-8202-c310f79b2c93 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:46:56 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] VM Started (Lifecycle Event)
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:46:56 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:46:56 user nova-compute[73208]: INFO nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:46:56 user nova-compute[73208]: INFO nova.compute.manager [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Took 15.70 seconds to build instance.
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-ab330a99-1a84-452c-8b7c-226e0dfc6431 req-0745b68d-a3ed-4191-b736-2bbf1c852a2b service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received event network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ab330a99-1a84-452c-8b7c-226e0dfc6431 req-0745b68d-a3ed-4191-b736-2bbf1c852a2b service nova] Acquiring lock "2df41dca-5906-4222-8202-c310f79b2c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ab330a99-1a84-452c-8b7c-226e0dfc6431 req-0745b68d-a3ed-4191-b736-2bbf1c852a2b service nova] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ab330a99-1a84-452c-8b7c-226e0dfc6431 req-0745b68d-a3ed-4191-b736-2bbf1c852a2b service nova] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG nova.compute.manager [req-ab330a99-1a84-452c-8b7c-226e0dfc6431 req-0745b68d-a3ed-4191-b736-2bbf1c852a2b service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] No waiting events found dispatching network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:46:56 user nova-compute[73208]: WARNING nova.compute.manager [req-ab330a99-1a84-452c-8b7c-226e0dfc6431 req-0745b68d-a3ed-4191-b736-2bbf1c852a2b service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received unexpected event network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 for instance with vm_state active and task_state None.
Aug 16 09:46:56 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-c02fdb3b-a563-4abf-8e58-bb2e7a478967 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "2df41dca-5906-4222-8202-c310f79b2c93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.808s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:46:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:46:57 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:57 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:46:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-9bdf1dae-1c49-4f9f-948f-c362c6fa08b3 req-dcf89fb6-8821-4c67-93ac-30d099698556 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-changed-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG nova.compute.manager [req-9bdf1dae-1c49-4f9f-948f-c362c6fa08b3 req-dcf89fb6-8821-4c67-93ac-30d099698556 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Refreshing instance network info cache due to event network-changed-e8498fd0-804d-40cc-9ad5-3bf025666824. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9bdf1dae-1c49-4f9f-948f-c362c6fa08b3 req-dcf89fb6-8821-4c67-93ac-30d099698556 service nova] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9bdf1dae-1c49-4f9f-948f-c362c6fa08b3 req-dcf89fb6-8821-4c67-93ac-30d099698556 service nova] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG nova.network.neutron [req-9bdf1dae-1c49-4f9f-948f-c362c6fa08b3 req-dcf89fb6-8821-4c67-93ac-30d099698556 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Refreshing network info cache for port e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG nova.objects.instance [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'flavor' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:11 user nova-compute[73208]: INFO nova.compute.manager [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Attaching volume e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 to /dev/vdb
Aug 16 09:47:11 user nova-compute[73208]: DEBUG os_brick.utils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0328952-2c1d-4a72-90a6-330ff9c932eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655ace6-9ba0-4520-9e4b-41ab2cdf20f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG nova.network.neutron [req-9bdf1dae-1c49-4f9f-948f-c362c6fa08b3 req-dcf89fb6-8821-4c67-93ac-30d099698556 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updated VIF entry in instance network info cache for port e8498fd0-804d-40cc-9ad5-3bf025666824. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG nova.network.neutron [req-9bdf1dae-1c49-4f9f-948f-c362c6fa08b3 req-dcf89fb6-8821-4c67-93ac-30d099698556 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f2f56c-d4da-4a70-856e-ef12f416d89d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc8cce-10a0-4e8e-ae8c-b2c8bb3352ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-9bdf1dae-1c49-4f9f-948f-c362c6fa08b3 req-dcf89fb6-8821-4c67-93ac-30d099698556 service nova] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:47:11 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:47:11 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a0a4e7-0557-4c00-b741-fe0d60c20633]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG os_brick.utils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:47:11 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating existing volume attachment record: 14c075c6-d535-4724-b649-500a338ebde2 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:47:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLrEenOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:47:21 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:47:21 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:47:21 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7825583-6420-4ad7-b430-2b25a1ecaa4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:47:21 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd56a418-f1d5-4e8b-82a4-f6a8f3b6ce18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713] added
Aug 16 09:47:21 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f288d9-bca8-44cd-a51b-d1d2858f40c7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[68827cb8-394c-4324-b3ba-09096a813e03]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLrEenOz {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLrEenOz" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9256d9-7d26-47b1-bc8c-4e986f710f42]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PLrEenOz'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddc8d85-7b67-49a3-bf0a-5129c45d5635]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97a240-8d1b-4a60-bb8b-9009cdba13fe]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:47:21 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:47:21 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90a79cd-685d-4967-b8d8-b6308a5a453a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713, portal: 172.16.0.220,3260]
Aug 16 09:47:21 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713, portal: 172.16.0.220,3260] successful.
Aug 16 09:47:21 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b7b727-f5df-4547-8628-e21fc3f45de0]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a5a663-af8d-4013-a56f-070b5c96af1d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:47:21 user nova-compute[73208]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:47:21 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:47:21 user nova-compute[73208]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:47:21 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d410661-f6a5-4d29-8577-ca6b80206675]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:47:21 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLrEenOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:47:22 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:47:22 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23538333161653362', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:47:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538333161653362', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:47:22 user nova-compute[73208]: DEBUG nova.objects.instance [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'flavor' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:47:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 09:47:22 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:47:22 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:47:22 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:47:22 user nova-compute[73208]:   <serial>e98c7d2d-fff4-4e5a-a740-e78d2d8e6713</serial>
Aug 16 09:47:22 user nova-compute[73208]: </disk>
Aug 16 09:47:22 user nova-compute[73208]:  {{(pid=73208) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 09:47:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:22 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:47:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:47:23 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No VIF found with MAC fa:16:3e:0c:47:f9, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:47:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-56ffac98-8b87-4894-8c0e-4e4303406197 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.881s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:24 user nova-compute[73208]: INFO nova.compute.manager [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Rescuing
Aug 16 09:47:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:47:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:47:24 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG nova.network.neutron [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-bd7261f9-33e1-45ef-914a-ca7e5c18814f req-298414cb-07c9-49f7-8abf-762313c007cd service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bd7261f9-33e1-45ef-914a-ca7e5c18814f req-298414cb-07c9-49f7-8abf-762313c007cd service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bd7261f9-33e1-45ef-914a-ca7e5c18814f req-298414cb-07c9-49f7-8abf-762313c007cd service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-bd7261f9-33e1-45ef-914a-ca7e5c18814f req-298414cb-07c9-49f7-8abf-762313c007cd service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-bd7261f9-33e1-45ef-914a-ca7e5c18814f req-298414cb-07c9-49f7-8abf-762313c007cd service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:47:25 user nova-compute[73208]: WARNING nova.compute.manager [req-bd7261f9-33e1-45ef-914a-ca7e5c18814f req-298414cb-07c9-49f7-8abf-762313c007cd service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state active and task_state rescuing.
Aug 16 09:47:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance destroyed successfully.
Aug 16 09:47:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Attempting rescue
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73208) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance directory exists: not creating {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 09:47:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Creating image(s)
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'trusted_certs' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484 --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a5b7b85246924fc4d2c8ce6e563707aaad89484,backing_fmt=raw /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue" returned: 0 in 0.055s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9a5b7b85246924fc4d2c8ce6e563707aaad89484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'migration_context' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Created local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Start _get_guest_xml network_info=[{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:0c:47:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '57e619ae-e236-4dcb-9810-c1a72d3e5cd4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'resources' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'numa_topology' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:47:26 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:47:26 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T09:02:39Z,direct_url=<?>,disk_format='qcow2',id=57e619ae-e236-4dcb-9810-c1a72d3e5cd4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9a105ce3e8db43af8a5ec03d265e8d3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T09:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'vcpu_model' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-268411743',display_name='tempest-ServerRescueNegativeTestJSON-server-268411743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-268411743',id=49,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAQzI8HEzk24A2xbzNXmAbNOg+HQtK1HQ1z355r6nO/ApLxwPlqbiukbUWpdEwi2gGODux3ryrZGTb/NmlaPO8o2WiJuvU6z0XcndSLjMM6AwB4tmrEWblna7vdS9dJvg==',key_name='tempest-keypair-1686473256',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:45:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-1x8vua74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=e3d52f21-689c-4b81-9f47-a98d822b0efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:0c:47:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "vif_mac": "fa:16:3e:0c:47:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=e8498fd0-804d-40cc-9ad5-3bf025666824,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8498fd0-80') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.objects.instance [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'pci_devices' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:47:26 user nova-compute[73208]:   <uuid>e3d52f21-689c-4b81-9f47-a98d822b0efe</uuid>
Aug 16 09:47:26 user nova-compute[73208]:   <name>instance-00000031</name>
Aug 16 09:47:26 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:47:26 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:47:26 user nova-compute[73208]:   <metadata>
Aug 16 09:47:26 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:47:26 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:47:26 user nova-compute[73208]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-268411743</nova:name>
Aug 16 09:47:26 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:47:26</nova:creationTime>
Aug 16 09:47:26 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:47:26 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:47:26 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:47:26 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:47:26 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:47:26 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:47:26 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:47:26 user nova-compute[73208]:       <nova:owner>
Aug 16 09:47:26 user nova-compute[73208]:         <nova:user uuid="a1fe7fe8c35c42aeaf87cf3c4d4a37d8">tempest-ServerRescueNegativeTestJSON-1153173897-project-member</nova:user>
Aug 16 09:47:26 user nova-compute[73208]:         <nova:project uuid="9e197c75147746a282a02c61bba8ef65">tempest-ServerRescueNegativeTestJSON-1153173897</nova:project>
Aug 16 09:47:26 user nova-compute[73208]:       </nova:owner>
Aug 16 09:47:26 user nova-compute[73208]:       <nova:root type="image" uuid="57e619ae-e236-4dcb-9810-c1a72d3e5cd4"/>
Aug 16 09:47:26 user nova-compute[73208]:       <nova:ports>
Aug 16 09:47:26 user nova-compute[73208]:         <nova:port uuid="e8498fd0-804d-40cc-9ad5-3bf025666824">
Aug 16 09:47:26 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 09:47:26 user nova-compute[73208]:         </nova:port>
Aug 16 09:47:26 user nova-compute[73208]:       </nova:ports>
Aug 16 09:47:26 user nova-compute[73208]:     </nova:instance>
Aug 16 09:47:26 user nova-compute[73208]:   </metadata>
Aug 16 09:47:26 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:47:26 user nova-compute[73208]:     <system>
Aug 16 09:47:26 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:47:26 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:47:26 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:47:26 user nova-compute[73208]:       <entry name="serial">e3d52f21-689c-4b81-9f47-a98d822b0efe</entry>
Aug 16 09:47:26 user nova-compute[73208]:       <entry name="uuid">e3d52f21-689c-4b81-9f47-a98d822b0efe</entry>
Aug 16 09:47:26 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:47:26 user nova-compute[73208]:     </system>
Aug 16 09:47:26 user nova-compute[73208]:   </sysinfo>
Aug 16 09:47:26 user nova-compute[73208]:   <os>
Aug 16 09:47:26 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:47:26 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:47:26 user nova-compute[73208]:   </os>
Aug 16 09:47:26 user nova-compute[73208]:   <features>
Aug 16 09:47:26 user nova-compute[73208]:     <acpi/>
Aug 16 09:47:26 user nova-compute[73208]:     <apic/>
Aug 16 09:47:26 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:47:26 user nova-compute[73208]:   </features>
Aug 16 09:47:26 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:47:26 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:47:26 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:47:26 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:47:26 user nova-compute[73208]:   </clock>
Aug 16 09:47:26 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:47:26 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:47:26 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:47:26 user nova-compute[73208]:   </cpu>
Aug 16 09:47:26 user nova-compute[73208]:   <devices>
Aug 16 09:47:26 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:47:26 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:47:26 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue"/>
Aug 16 09:47:26 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:47:26 user nova-compute[73208]:     </disk>
Aug 16 09:47:26 user nova-compute[73208]:     <disk type="file" device="disk">
Aug 16 09:47:26 user nova-compute[73208]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 09:47:26 user nova-compute[73208]:       <source file="/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk"/>
Aug 16 09:47:26 user nova-compute[73208]:       <target dev="vdb" bus="virtio"/>
Aug 16 09:47:26 user nova-compute[73208]:     </disk>
Aug 16 09:47:26 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:47:26 user nova-compute[73208]:       <mac address="fa:16:3e:0c:47:f9"/>
Aug 16 09:47:26 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:47:26 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:47:26 user nova-compute[73208]:       <target dev="tape8498fd0-80"/>
Aug 16 09:47:26 user nova-compute[73208]:     </interface>
Aug 16 09:47:26 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:47:26 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/console.log" append="off"/>
Aug 16 09:47:26 user nova-compute[73208]:     </serial>
Aug 16 09:47:26 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:47:26 user nova-compute[73208]:     <video>
Aug 16 09:47:26 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:47:26 user nova-compute[73208]:     </video>
Aug 16 09:47:26 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:47:26 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:47:26 user nova-compute[73208]:     </rng>
Aug 16 09:47:26 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:47:26 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:47:26 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:47:26 user nova-compute[73208]:     </memballoon>
Aug 16 09:47:26 user nova-compute[73208]:   </devices>
Aug 16 09:47:26 user nova-compute[73208]: </domain>
Aug 16 09:47:26 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:47:26 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance destroyed successfully.
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:47:26 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] No VIF found with MAC fa:16:3e:0c:47:f9, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:47:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-4790fab3-1ad5-4aa9-a881-55750b3b93e2 req-47c43b8d-759e-4fd8-b2a2-5ea69dafcfb9 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4790fab3-1ad5-4aa9-a881-55750b3b93e2 req-47c43b8d-759e-4fd8-b2a2-5ea69dafcfb9 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4790fab3-1ad5-4aa9-a881-55750b3b93e2 req-47c43b8d-759e-4fd8-b2a2-5ea69dafcfb9 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4790fab3-1ad5-4aa9-a881-55750b3b93e2 req-47c43b8d-759e-4fd8-b2a2-5ea69dafcfb9 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-4790fab3-1ad5-4aa9-a881-55750b3b93e2 req-47c43b8d-759e-4fd8-b2a2-5ea69dafcfb9 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:47:28 user nova-compute[73208]: WARNING nova.compute.manager [req-4790fab3-1ad5-4aa9-a881-55750b3b93e2 req-47c43b8d-759e-4fd8-b2a2-5ea69dafcfb9 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state active and task_state rescuing.
Aug 16 09:47:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:47:30 user nova-compute[73208]: WARNING nova.compute.manager [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state active and task_state rescuing.
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:47:30 user nova-compute[73208]: WARNING nova.compute.manager [req-ffacdfb1-f453-4084-9878-73e9ddc92a95 req-49bd54ff-c1b9-42b1-9949-bbee7edec8e6 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state active and task_state rescuing.
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for e3d52f21-689c-4b81-9f47-a98d822b0efe due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179250.1615574, e3d52f21-689c-4b81-9f47-a98d822b0efe => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:47:30 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] VM Resumed (Lifecycle Event)
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-4c1faa60-1217-4df6-b5c0-1848c18ddf8c tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:47:30 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179250.1629348, e3d52f21-689c-4b81-9f47-a98d822b0efe => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:47:30 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] VM Started (Lifecycle Event)
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:47:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:47:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:47:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:47:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:47:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:47:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:47:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:44 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:45 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:47:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:45 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:47:47 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:47:47 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:47:47 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8343MB free_disk=25.211627960205078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e3d52f21-689c-4b81-9f47-a98d822b0efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 2df41dca-5906-4222-8202-c310f79b2c93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:47:47 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:47:48 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:47:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:47:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:47:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:47:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:47:57 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:47:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:05 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:48:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:48:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:48:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:48:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:48:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:48:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:48:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:48:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:13 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:13 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:48:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:48:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:48:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:48:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:48:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:48:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:48:30 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:48:30 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:48:31 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-da2f80f5-69f6-4d1b-b498-556d1db5e83a req-2fe3d2b2-005a-45d8-93e0-8e74e0eedad3 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received event network-changed-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG nova.compute.manager [req-da2f80f5-69f6-4d1b-b498-556d1db5e83a req-2fe3d2b2-005a-45d8-93e0-8e74e0eedad3 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Refreshing instance network info cache due to event network-changed-be24d861-f555-416f-ba04-4ad5dd382810. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-da2f80f5-69f6-4d1b-b498-556d1db5e83a req-2fe3d2b2-005a-45d8-93e0-8e74e0eedad3 service nova] Acquiring lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-da2f80f5-69f6-4d1b-b498-556d1db5e83a req-2fe3d2b2-005a-45d8-93e0-8e74e0eedad3 service nova] Acquired lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG nova.network.neutron [req-da2f80f5-69f6-4d1b-b498-556d1db5e83a req-2fe3d2b2-005a-45d8-93e0-8e74e0eedad3 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Refreshing network info cache for port be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG nova.network.neutron [req-da2f80f5-69f6-4d1b-b498-556d1db5e83a req-2fe3d2b2-005a-45d8-93e0-8e74e0eedad3 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Updated VIF entry in instance network info cache for port be24d861-f555-416f-ba04-4ad5dd382810. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG nova.network.neutron [req-da2f80f5-69f6-4d1b-b498-556d1db5e83a req-2fe3d2b2-005a-45d8-93e0-8e74e0eedad3 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Updating instance_info_cache with network_info: [{"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:48:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-da2f80f5-69f6-4d1b-b498-556d1db5e83a req-2fe3d2b2-005a-45d8-93e0-8e74e0eedad3 service nova] Releasing lock "refresh_cache-2df41dca-5906-4222-8202-c310f79b2c93" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "2df41dca-5906-4222-8202-c310f79b2c93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "2df41dca-5906-4222-8202-c310f79b2c93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "2df41dca-5906-4222-8202-c310f79b2c93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:48:33 user nova-compute[73208]: INFO nova.compute.manager [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Terminating instance
Aug 16 09:48:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:33 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Instance destroyed successfully.
Aug 16 09:48:33 user nova-compute[73208]: DEBUG nova.objects.instance [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'resources' on Instance uuid 2df41dca-5906-4222-8202-c310f79b2c93 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-215832511',display_name='tempest-TestVolumeBootPattern-server-215832511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-215832511',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-srlj35xr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:46:56Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=2df41dca-5906-4222-8202-c310f79b2c93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "be24d861-f555-416f-ba04-4ad5dd382810", "address": "fa:16:3e:f7:6b:c7", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24d861-f5", "ovs_interfaceid": "be24d861-f555-416f-ba04-4ad5dd382810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6b:c7,bridge_name='br-int',has_traffic_filtering=True,id=be24d861-f555-416f-ba04-4ad5dd382810,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24d861-f5') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_vif [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6b:c7,bridge_name='br-int',has_traffic_filtering=True,id=be24d861-f555-416f-ba04-4ad5dd382810,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24d861-f5') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe24d861-f5, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:33 user nova-compute[73208]: INFO os_vif [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:6b:c7,bridge_name='br-int',has_traffic_filtering=True,id=be24d861-f555-416f-ba04-4ad5dd382810,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24d861-f5')
Aug 16 09:48:33 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHUMSaYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:48:33 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98eacbf-726f-411f-adcc-3b1c591f44c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6918ae-95d0-4f10-86e3-3efbdac58122]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:48:33 user nova-compute[73208]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:48:33 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:48:33 user nova-compute[73208]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:48:33 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0258160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7125551-7106-4b5d-b408-3e48dbde7109]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[533b127d-2be9-413f-b735-fa79c75c90ce]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb85545-08a6-4890-88c5-c77453fac431]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e730dc0-1953-479c-b929-f1c1e14c7240]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ee7537a', '/dev/disk/by-id/scsi-23763633936623062', '/dev/disk/by-id/scsi-1SCST_BIO7ee7537a-7cc96b0b650e99bb') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713eaca-7294-4fe0-a27e-716eeaad53c6]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c97e2e-5146-46c9-a2a8-da22d870d236]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:48:33 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ddf7e-997b-4671-bea7-2abe8d3166e6]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260]
Aug 16 09:48:34 user nova-compute[73208]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260] successful.
Aug 16 09:48:34 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[94738ece-a7e4-4caf-8ff9-9ece24e75288]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== disconnect_volume: return (273ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:48:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Deleting instance files /opt/stack/data/nova/instances/2df41dca-5906-4222-8202-c310f79b2c93_del
Aug 16 09:48:34 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Deletion of /opt/stack/data/nova/instances/2df41dca-5906-4222-8202-c310f79b2c93_del complete
Aug 16 09:48:34 user nova-compute[73208]: INFO nova.compute.manager [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received event network-vif-unplugged-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] Acquiring lock "2df41dca-5906-4222-8202-c310f79b2c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] No waiting events found dispatching network-vif-unplugged-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received event network-vif-unplugged-be24d861-f555-416f-ba04-4ad5dd382810 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received event network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] Acquiring lock "2df41dca-5906-4222-8202-c310f79b2c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] Lock "2df41dca-5906-4222-8202-c310f79b2c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.compute.manager [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] No waiting events found dispatching network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:48:34 user nova-compute[73208]: WARNING nova.compute.manager [req-941dee76-9575-4294-8cc4-41fadcf04103 req-ed50e2f1-50b7-47da-9a84-091cc4ce261c service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received unexpected event network-vif-plugged-be24d861-f555-416f-ba04-4ad5dd382810 for instance with vm_state active and task_state deleting.
Aug 16 09:48:34 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:48:34 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Took 0.70 seconds to deallocate network for instance.
Aug 16 09:48:35 user nova-compute[73208]: INFO nova.compute.manager [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Took 0.96 seconds to detach 1 volumes for instance.
Aug 16 09:48:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:48:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:48:36 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:48:36 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:48:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:48:36 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Deleted allocations for instance 2df41dca-5906-4222-8202-c310f79b2c93
Aug 16 09:48:36 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-dc1fdf4d-75ce-45ff-ac4a-e08ab5f596a4 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "2df41dca-5906-4222-8202-c310f79b2c93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.144s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:48:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:36 user nova-compute[73208]: DEBUG nova.compute.manager [req-a481b60d-b115-4ca6-93ce-1d23cc78eb1a req-eb97dd41-72d0-403a-af56-a18562ea60b4 service nova] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Received event network-vif-deleted-be24d861-f555-416f-ba04-4ad5dd382810 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:48:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:48:45 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:48:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:48:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:48:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:48:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:48:48 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:48:48 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=25.21050262451172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e3d52f21-689c-4b81-9f47-a98d822b0efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179313.7482078, 2df41dca-5906-4222-8202-c310f79b2c93 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:48:48 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] VM Stopped (Lifecycle Event)
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.manager [None req-a9af7652-85f4-4be5-ad8b-4cfddf9ea20e None None] [instance: 2df41dca-5906-4222-8202-c310f79b2c93] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:48:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:48:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:48:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:56 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:48:56 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:48:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:48:59 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:01 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:49:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:49:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:49:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:49:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:49:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:49:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:49:16 user nova-compute[73208]: INFO nova.compute.manager [None req-3f999572-fb40-4cd3-8c6b-4d48cec34240 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Unrescuing
Aug 16 09:49:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f999572-fb40-4cd3-8c6b-4d48cec34240 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f999572-fb40-4cd3-8c6b-4d48cec34240 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3f999572-fb40-4cd3-8c6b-4d48cec34240 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG nova.network.neutron [None req-3f999572-fb40-4cd3-8c6b-4d48cec34240 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-3f999572-fb40-4cd3-8c6b-4d48cec34240 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG nova.objects.instance [None req-3f999572-fb40-4cd3-8c6b-4d48cec34240 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'flavor' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-6e418b78-9004-42e7-b342-167598acc57b req-b37d1eff-e159-455e-bdef-07e9f44c4ab1 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e418b78-9004-42e7-b342-167598acc57b req-b37d1eff-e159-455e-bdef-07e9f44c4ab1 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e418b78-9004-42e7-b342-167598acc57b req-b37d1eff-e159-455e-bdef-07e9f44c4ab1 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-6e418b78-9004-42e7-b342-167598acc57b req-b37d1eff-e159-455e-bdef-07e9f44c4ab1 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG nova.compute.manager [req-6e418b78-9004-42e7-b342-167598acc57b req-b37d1eff-e159-455e-bdef-07e9f44c4ab1 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:49:16 user nova-compute[73208]: WARNING nova.compute.manager [req-6e418b78-9004-42e7-b342-167598acc57b req-b37d1eff-e159-455e-bdef-07e9f44c4ab1 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:49:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:17 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance destroyed successfully.
Aug 16 09:49:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:49:18 user nova-compute[73208]: WARNING nova.compute.manager [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:49:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:18 user nova-compute[73208]: DEBUG nova.compute.manager [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:49:18 user nova-compute[73208]: WARNING nova.compute.manager [req-90030115-adfc-49cc-ad6d-9147a8c05384 req-1aa295c3-c7be-468c-a868-6ce3d4737eb4 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state rescued and task_state unrescuing.
Aug 16 09:49:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Removed pending event for e3d52f21-689c-4b81-9f47-a98d822b0efe due to event {{(pid=73208) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179360.7758331, e3d52f21-689c-4b81-9f47-a98d822b0efe => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:49:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] VM Resumed (Lifecycle Event)
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-3f999572-fb40-4cd3-8c6b-4d48cec34240 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:49:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179360.779135, e3d52f21-689c-4b81-9f47-a98d822b0efe => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:49:20 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] VM Started (Lifecycle Event)
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-7cacc1ed-0d29-4714-8b8c-1b298b344472 req-c0f7a904-fb24-4378-b9e9-95b5ea16c2ef service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7cacc1ed-0d29-4714-8b8c-1b298b344472 req-c0f7a904-fb24-4378-b9e9-95b5ea16c2ef service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7cacc1ed-0d29-4714-8b8c-1b298b344472 req-c0f7a904-fb24-4378-b9e9-95b5ea16c2ef service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-7cacc1ed-0d29-4714-8b8c-1b298b344472 req-c0f7a904-fb24-4378-b9e9-95b5ea16c2ef service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:20 user nova-compute[73208]: DEBUG nova.compute.manager [req-7cacc1ed-0d29-4714-8b8c-1b298b344472 req-c0f7a904-fb24-4378-b9e9-95b5ea16c2ef service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:49:20 user nova-compute[73208]: WARNING nova.compute.manager [req-7cacc1ed-0d29-4714-8b8c-1b298b344472 req-c0f7a904-fb24-4378-b9e9-95b5ea16c2ef service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state active and task_state None.
Aug 16 09:49:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:49:25 user nova-compute[73208]: INFO nova.compute.claims [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Claim successful on node user
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.network.neutron [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:49:25 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.policy [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae7839fe33794c6bb9c70f3005eab84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae086cfe405c4b9f80eef45ccae6d408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:49:25 user nova-compute[73208]: INFO nova.virt.block_device [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Booting with volume fe049d2b-4779-4365-9ae8-b22de023b39d at /dev/vda
Aug 16 09:49:25 user nova-compute[73208]: DEBUG os_brick.utils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd61bc6e-04d3-4495-94fb-ff18deba120c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eabc42-eb08-4f8b-952b-95ea8d6dac28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d698c58-8403-4a53-a0df-18e510da0731]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad9142-4854-4265-8c40-9d83ee6099e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:49:25 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:49:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[92786ab2-cc97-47a1-b975-12c7823b49fe]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG os_brick.utils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:49:25 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updating existing volume attachment record: a8ac2c16-6d19-45d9-b836-48a3a861c320 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:49:26 user nova-compute[73208]: DEBUG nova.network.neutron [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Successfully created port: 8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG nova.network.neutron [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Successfully updated port: 8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquired lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG nova.network.neutron [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-d1f7a5b9-35df-462c-b0ca-56b4c914f320 req-3f03b712-f57a-4656-be36-91573bfe071b service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-changed-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-d1f7a5b9-35df-462c-b0ca-56b4c914f320 req-3f03b712-f57a-4656-be36-91573bfe071b service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Refreshing instance network info cache due to event network-changed-8f204e39-2803-41a6-8040-d680eff47233. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d1f7a5b9-35df-462c-b0ca-56b4c914f320 req-3f03b712-f57a-4656-be36-91573bfe071b service nova] Acquiring lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG nova.network.neutron [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG nova.network.neutron [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updating instance_info_cache with network_info: [{"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Releasing lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Instance network_info: |[{"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d1f7a5b9-35df-462c-b0ca-56b4c914f320 req-3f03b712-f57a-4656-be36-91573bfe071b service nova] Acquired lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:49:27 user nova-compute[73208]: DEBUG nova.network.neutron [req-d1f7a5b9-35df-462c-b0ca-56b4c914f320 req-3f03b712-f57a-4656-be36-91573bfe071b service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Refreshing network info cache for port 8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-d1f7a5b9-35df-462c-b0ca-56b4c914f320 req-3f03b712-f57a-4656-be36-91573bfe071b service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updated VIF entry in instance network info cache for port 8f204e39-2803-41a6-8040-d680eff47233. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-d1f7a5b9-35df-462c-b0ca-56b4c914f320 req-3f03b712-f57a-4656-be36-91573bfe071b service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updating instance_info_cache with network_info: [{"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d1f7a5b9-35df-462c-b0ca-56b4c914f320 req-3f03b712-f57a-4656-be36-91573bfe071b service nova] Releasing lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:49:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:49:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:49:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:49:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:49:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:49:35 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Creating image(s)
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Ensure instance console log exists: /opt/stack/data/nova/instances/30d1dc43-1977-43b6-a3c4-a38b52d7b25c/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Start _get_guest_xml network_info=[{"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'a8ac2c16-6d19-45d9-b836-48a3a861c320', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHUMSaYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30d1dc43-1977-43b6-a3c4-a38b52d7b25c', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe049d2b-4779-4365-9ae8-b22de023b39d', 'serial': 'fe049d2b-4779-4365-9ae8-b22de023b39d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:49:35 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:49:35 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHUMSaYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:49:35 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:49:35 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:49:35 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc1b473-4440-407e-84d3-ea8b6511ebca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:49:35 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0eae6f-8672-4fdc-9695-df548551700a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d] added
Aug 16 09:49:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e7267c-5789-4718-a61c-5249cd500b9a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf007e0-c53c-46d9-8704-ff436153831d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHUMSaYI {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHUMSaYI" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[0639d843-c196-4348-91ca-9768a6f0dd5a]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eHUMSaYI'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aed02d-b0f5-4032-8a84-97165502790e]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[01980cc9-3724-43ee-8578-a1e7c515c6dd]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:49:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:49:35 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:49:35 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ab6838-f541-4db4-9874-cdad21a43736]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260]
Aug 16 09:49:36 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260] successful.
Aug 16 09:49:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d408b48b-f855-4d1c-ae0e-d0066362dbc1]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe06c4db-c7ba-445a-bb07-e48f6498fcdf]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:49:36 user nova-compute[73208]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:49:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:49:36 user nova-compute[73208]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:49:36 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee54c04-14c9-4d89-8787-f0f047e54a89]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:49:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHUMSaYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23763633936623062', 'path': '/dev/sdb'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763633936623062', 'path': '/dev/sdb'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-324162672',display_name='tempest-TestVolumeBootPattern-server-324162672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-324162672',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-8vwmlu5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:49:26Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=30d1dc43-1977-43b6-a3c4-a38b52d7b25c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:d3,bridge_name='br-int',has_traffic_filtering=True,id=8f204e39-2803-41a6-8040-d680eff47233,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f204e39-28') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.objects.instance [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'pci_devices' on Instance uuid 30d1dc43-1977-43b6-a3c4-a38b52d7b25c {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:49:37 user nova-compute[73208]:   <uuid>30d1dc43-1977-43b6-a3c4-a38b52d7b25c</uuid>
Aug 16 09:49:37 user nova-compute[73208]:   <name>instance-00000033</name>
Aug 16 09:49:37 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:49:37 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:49:37 user nova-compute[73208]:   <metadata>
Aug 16 09:49:37 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:49:37 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:49:37 user nova-compute[73208]:       <nova:name>tempest-TestVolumeBootPattern-server-324162672</nova:name>
Aug 16 09:49:37 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:49:35</nova:creationTime>
Aug 16 09:49:37 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:49:37 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:49:37 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:49:37 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:49:37 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:49:37 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:49:37 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:49:37 user nova-compute[73208]:       <nova:owner>
Aug 16 09:49:37 user nova-compute[73208]:         <nova:user uuid="ae7839fe33794c6bb9c70f3005eab84f">tempest-TestVolumeBootPattern-1567175042-project-member</nova:user>
Aug 16 09:49:37 user nova-compute[73208]:         <nova:project uuid="ae086cfe405c4b9f80eef45ccae6d408">tempest-TestVolumeBootPattern-1567175042</nova:project>
Aug 16 09:49:37 user nova-compute[73208]:       </nova:owner>
Aug 16 09:49:37 user nova-compute[73208]:       <nova:ports>
Aug 16 09:49:37 user nova-compute[73208]:         <nova:port uuid="8f204e39-2803-41a6-8040-d680eff47233">
Aug 16 09:49:37 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 09:49:37 user nova-compute[73208]:         </nova:port>
Aug 16 09:49:37 user nova-compute[73208]:       </nova:ports>
Aug 16 09:49:37 user nova-compute[73208]:     </nova:instance>
Aug 16 09:49:37 user nova-compute[73208]:   </metadata>
Aug 16 09:49:37 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:49:37 user nova-compute[73208]:     <system>
Aug 16 09:49:37 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:49:37 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:49:37 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:49:37 user nova-compute[73208]:       <entry name="serial">30d1dc43-1977-43b6-a3c4-a38b52d7b25c</entry>
Aug 16 09:49:37 user nova-compute[73208]:       <entry name="uuid">30d1dc43-1977-43b6-a3c4-a38b52d7b25c</entry>
Aug 16 09:49:37 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:49:37 user nova-compute[73208]:     </system>
Aug 16 09:49:37 user nova-compute[73208]:   </sysinfo>
Aug 16 09:49:37 user nova-compute[73208]:   <os>
Aug 16 09:49:37 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:49:37 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:49:37 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:49:37 user nova-compute[73208]:   </os>
Aug 16 09:49:37 user nova-compute[73208]:   <features>
Aug 16 09:49:37 user nova-compute[73208]:     <acpi/>
Aug 16 09:49:37 user nova-compute[73208]:     <apic/>
Aug 16 09:49:37 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:49:37 user nova-compute[73208]:   </features>
Aug 16 09:49:37 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:49:37 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:49:37 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:49:37 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:49:37 user nova-compute[73208]:   </clock>
Aug 16 09:49:37 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:49:37 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:49:37 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:49:37 user nova-compute[73208]:   </cpu>
Aug 16 09:49:37 user nova-compute[73208]:   <devices>
Aug 16 09:49:37 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:49:37 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:49:37 user nova-compute[73208]:       <source dev="/dev/sdb"/>
Aug 16 09:49:37 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:49:37 user nova-compute[73208]:       <serial>fe049d2b-4779-4365-9ae8-b22de023b39d</serial>
Aug 16 09:49:37 user nova-compute[73208]:     </disk>
Aug 16 09:49:37 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:49:37 user nova-compute[73208]:       <mac address="fa:16:3e:56:fb:d3"/>
Aug 16 09:49:37 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:49:37 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:49:37 user nova-compute[73208]:       <target dev="tap8f204e39-28"/>
Aug 16 09:49:37 user nova-compute[73208]:     </interface>
Aug 16 09:49:37 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:49:37 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/30d1dc43-1977-43b6-a3c4-a38b52d7b25c/console.log" append="off"/>
Aug 16 09:49:37 user nova-compute[73208]:     </serial>
Aug 16 09:49:37 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:49:37 user nova-compute[73208]:     <video>
Aug 16 09:49:37 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:49:37 user nova-compute[73208]:     </video>
Aug 16 09:49:37 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:49:37 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:49:37 user nova-compute[73208]:     </rng>
Aug 16 09:49:37 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:49:37 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:49:37 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:49:37 user nova-compute[73208]:     </memballoon>
Aug 16 09:49:37 user nova-compute[73208]:   </devices>
Aug 16 09:49:37 user nova-compute[73208]: </domain>
Aug 16 09:49:37 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-324162672',display_name='tempest-TestVolumeBootPattern-server-324162672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-324162672',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-8vwmlu5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:49:26Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=30d1dc43-1977-43b6-a3c4-a38b52d7b25c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:d3,bridge_name='br-int',has_traffic_filtering=True,id=8f204e39-2803-41a6-8040-d680eff47233,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f204e39-28') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG os_vif [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:d3,bridge_name='br-int',has_traffic_filtering=True,id=8f204e39-2803-41a6-8040-d680eff47233,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f204e39-28') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f204e39-28, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f204e39-28, col_values=(('external_ids', {'iface-id': '8f204e39-2803-41a6-8040-d680eff47233', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:fb:d3', 'vm-uuid': '30d1dc43-1977-43b6-a3c4-a38b52d7b25c'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:37 user nova-compute[73208]: INFO os_vif [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:d3,bridge_name='br-int',has_traffic_filtering=True,id=8f204e39-2803-41a6-8040-d680eff47233,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f204e39-28')
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:49:37 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No VIF found with MAC fa:16:3e:56:fb:d3, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:49:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-f5df3975-92ff-4f63-a29d-38d702bd1a95 req-30e6b00b-006f-468b-b131-1000c51b3906 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:49:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5df3975-92ff-4f63-a29d-38d702bd1a95 req-30e6b00b-006f-468b-b131-1000c51b3906 service nova] Acquiring lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5df3975-92ff-4f63-a29d-38d702bd1a95 req-30e6b00b-006f-468b-b131-1000c51b3906 service nova] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:38 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f5df3975-92ff-4f63-a29d-38d702bd1a95 req-30e6b00b-006f-468b-b131-1000c51b3906 service nova] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:38 user nova-compute[73208]: DEBUG nova.compute.manager [req-f5df3975-92ff-4f63-a29d-38d702bd1a95 req-30e6b00b-006f-468b-b131-1000c51b3906 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] No waiting events found dispatching network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:49:38 user nova-compute[73208]: WARNING nova.compute.manager [req-f5df3975-92ff-4f63-a29d-38d702bd1a95 req-30e6b00b-006f-468b-b131-1000c51b3906 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received unexpected event network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 for instance with vm_state building and task_state spawning.
Aug 16 09:49:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:39 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179380.6714642, 30d1dc43-1977-43b6-a3c4-a38b52d7b25c => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:49:40 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] VM Resumed (Lifecycle Event)
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:49:40 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Instance spawned successfully.
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:49:40 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179380.6727445, 30d1dc43-1977-43b6-a3c4-a38b52d7b25c => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:49:40 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] VM Started (Lifecycle Event)
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:49:40 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:49:40 user nova-compute[73208]: INFO nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-41a8277c-6b0a-4120-991c-ea0154003a77 req-26b6c0fa-3727-495c-9f83-034f92b9414a service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-41a8277c-6b0a-4120-991c-ea0154003a77 req-26b6c0fa-3727-495c-9f83-034f92b9414a service nova] Acquiring lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-41a8277c-6b0a-4120-991c-ea0154003a77 req-26b6c0fa-3727-495c-9f83-034f92b9414a service nova] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-41a8277c-6b0a-4120-991c-ea0154003a77 req-26b6c0fa-3727-495c-9f83-034f92b9414a service nova] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:40 user nova-compute[73208]: DEBUG nova.compute.manager [req-41a8277c-6b0a-4120-991c-ea0154003a77 req-26b6c0fa-3727-495c-9f83-034f92b9414a service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] No waiting events found dispatching network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:49:40 user nova-compute[73208]: WARNING nova.compute.manager [req-41a8277c-6b0a-4120-991c-ea0154003a77 req-26b6c0fa-3727-495c-9f83-034f92b9414a service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received unexpected event network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 for instance with vm_state building and task_state spawning.
Aug 16 09:49:40 user nova-compute[73208]: INFO nova.compute.manager [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Took 15.68 seconds to build instance.
Aug 16 09:49:40 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-cdcc5c79-dfaa-4f4a-bf2f-16b6a956c882 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.774s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:41 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:49:48 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:49:48 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8407MB free_disk=25.208232879638672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e3d52f21-689c-4b81-9f47-a98d822b0efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 30d1dc43-1977-43b6-a3c4-a38b52d7b25c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:49:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:49:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:49:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:52 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:56 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:56 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:49:57 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:49:57 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:50:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:01 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:50:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:50:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:50:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:50:46 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:50:46 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:50:46 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:50:47 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:50:48 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:50:48 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8466MB free_disk=25.207538604736328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e3d52f21-689c-4b81-9f47-a98d822b0efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 30d1dc43-1977-43b6-a3c4-a38b52d7b25c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:50:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:50:50 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:50 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:50:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:50:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:50:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:50:51 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [{"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:50:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-9dd3d75b-db07-4907-854c-42278f817bb9" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:50:51 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:50:51 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:51 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:50:52 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:57 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:50:57 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:58 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:50:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:51:02 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:02 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:03 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:07 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-06cb3677-c5e3-462b-87da-2d33bdd3f73f req-a3dc0e34-be65-4b2b-8827-d45b199f752b service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-changed-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-06cb3677-c5e3-462b-87da-2d33bdd3f73f req-a3dc0e34-be65-4b2b-8827-d45b199f752b service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Refreshing instance network info cache due to event network-changed-e8498fd0-804d-40cc-9ad5-3bf025666824. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-06cb3677-c5e3-462b-87da-2d33bdd3f73f req-a3dc0e34-be65-4b2b-8827-d45b199f752b service nova] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-06cb3677-c5e3-462b-87da-2d33bdd3f73f req-a3dc0e34-be65-4b2b-8827-d45b199f752b service nova] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-06cb3677-c5e3-462b-87da-2d33bdd3f73f req-a3dc0e34-be65-4b2b-8827-d45b199f752b service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Refreshing network info cache for port e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:08 user nova-compute[73208]: INFO nova.compute.manager [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Detaching volume e98c7d2d-fff4-4e5a-a740-e78d2d8e6713
Aug 16 09:51:08 user nova-compute[73208]: INFO nova.virt.block_device [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Attempting to driver detach volume e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 from mountpoint /dev/vdb
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Attempting to detach device vdb from instance e3d52f21-689c-4b81-9f47-a98d822b0efe from the persistent domain config. {{(pid=73208) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:51:08 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:51:08 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:51:08 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:51:08 user nova-compute[73208]:   <serial>e98c7d2d-fff4-4e5a-a740-e78d2d8e6713</serial>
Aug 16 09:51:08 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:51:08 user nova-compute[73208]: </disk>
Aug 16 09:51:08 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:51:08 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Successfully detached device vdb from instance e3d52f21-689c-4b81-9f47-a98d822b0efe from the persistent domain config.
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3d52f21-689c-4b81-9f47-a98d822b0efe from the live domain config. {{(pid=73208) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.virt.libvirt.guest [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 09:51:08 user nova-compute[73208]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:51:08 user nova-compute[73208]:   <source dev="/dev/sdc"/>
Aug 16 09:51:08 user nova-compute[73208]:   <target dev="vdb" bus="virtio"/>
Aug 16 09:51:08 user nova-compute[73208]:   <serial>e98c7d2d-fff4-4e5a-a740-e78d2d8e6713</serial>
Aug 16 09:51:08 user nova-compute[73208]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 09:51:08 user nova-compute[73208]: </disk>
Aug 16 09:51:08 user nova-compute[73208]:  {{(pid=73208) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-06cb3677-c5e3-462b-87da-2d33bdd3f73f req-a3dc0e34-be65-4b2b-8827-d45b199f752b service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updated VIF entry in instance network info cache for port e8498fd0-804d-40cc-9ad5-3bf025666824. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG nova.network.neutron [req-06cb3677-c5e3-462b-87da-2d33bdd3f73f req-a3dc0e34-be65-4b2b-8827-d45b199f752b service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:51:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-06cb3677-c5e3-462b-87da-2d33bdd3f73f req-a3dc0e34-be65-4b2b-8827-d45b199f752b service nova] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Received event <DeviceRemovedEvent: 1692179469.1943567, e3d52f21-689c-4b81-9f47-a98d822b0efe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73208) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 09:51:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Successfully detached device vdb from instance e3d52f21-689c-4b81-9f47-a98d822b0efe from the live domain config.
Aug 16 09:51:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLrEenOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:51:09 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a80992-af47-44ba-8168-35be81fa02eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[336257a5-948d-4bee-9b21-11f999300b20]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:51:09 user nova-compute[73208]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:51:09 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 (non-flash)
Aug 16 09:51:09 user nova-compute[73208]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:51:09 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0185240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ac11a-b882-4cb6-83ed-487b40140d54]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cef782-4fc4-470c-91df-072e32423e32]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[526b2955-391e-4a8c-b4b6-f5bf91d6728d]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c7d692-3a6b-488a-a163-63260d69a55e]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b5d51d-ef5b-4fd4-b529-294a8c4011df]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[195cd7e9-8c42-4375-958d-53aa9a01f34b]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713, portal: 172.16.0.220,3260]
Aug 16 09:51:09 user nova-compute[73208]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713, portal: 172.16.0.220,3260] successful.
Aug 16 09:51:09 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98c7d2d-fff4-4e5a-a740-e78d2d8e6713 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd30c608-d943-42eb-8611-4763f5c64841]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] <== disconnect_volume: return (279ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:51:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG nova.objects.instance [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'flavor' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-f4e780db-7005-4541-b993-cdb16acdd521 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-a9b2ff34-ef43-4612-842e-8a3c2039c831 req-1f829aa3-560c-4083-87d1-555305e09d80 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-changed-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-a9b2ff34-ef43-4612-842e-8a3c2039c831 req-1f829aa3-560c-4083-87d1-555305e09d80 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Refreshing instance network info cache due to event network-changed-e8498fd0-804d-40cc-9ad5-3bf025666824. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a9b2ff34-ef43-4612-842e-8a3c2039c831 req-1f829aa3-560c-4083-87d1-555305e09d80 service nova] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a9b2ff34-ef43-4612-842e-8a3c2039c831 req-1f829aa3-560c-4083-87d1-555305e09d80 service nova] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-a9b2ff34-ef43-4612-842e-8a3c2039c831 req-1f829aa3-560c-4083-87d1-555305e09d80 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Refreshing network info cache for port e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-a9b2ff34-ef43-4612-842e-8a3c2039c831 req-1f829aa3-560c-4083-87d1-555305e09d80 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updated VIF entry in instance network info cache for port e8498fd0-804d-40cc-9ad5-3bf025666824. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG nova.network.neutron [req-a9b2ff34-ef43-4612-842e-8a3c2039c831 req-1f829aa3-560c-4083-87d1-555305e09d80 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:51:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-a9b2ff34-ef43-4612-842e-8a3c2039c831 req-1f829aa3-560c-4083-87d1-555305e09d80 service nova] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:51:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:12 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-1b8a5aa4-6e6d-4683-8d5d-1babd22995bd req-a404dad4-ec68-4270-a321-81a4a8b41035 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-changed-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG nova.compute.manager [req-1b8a5aa4-6e6d-4683-8d5d-1babd22995bd req-a404dad4-ec68-4270-a321-81a4a8b41035 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Refreshing instance network info cache due to event network-changed-8f204e39-2803-41a6-8040-d680eff47233. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1b8a5aa4-6e6d-4683-8d5d-1babd22995bd req-a404dad4-ec68-4270-a321-81a4a8b41035 service nova] Acquiring lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1b8a5aa4-6e6d-4683-8d5d-1babd22995bd req-a404dad4-ec68-4270-a321-81a4a8b41035 service nova] Acquired lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG nova.network.neutron [req-1b8a5aa4-6e6d-4683-8d5d-1babd22995bd req-a404dad4-ec68-4270-a321-81a4a8b41035 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Refreshing network info cache for port 8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG nova.network.neutron [req-1b8a5aa4-6e6d-4683-8d5d-1babd22995bd req-a404dad4-ec68-4270-a321-81a4a8b41035 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updated VIF entry in instance network info cache for port 8f204e39-2803-41a6-8040-d680eff47233. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG nova.network.neutron [req-1b8a5aa4-6e6d-4683-8d5d-1babd22995bd req-a404dad4-ec68-4270-a321-81a4a8b41035 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updating instance_info_cache with network_info: [{"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:51:17 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-1b8a5aa4-6e6d-4683-8d5d-1babd22995bd req-a404dad4-ec68-4270-a321-81a4a8b41035 service nova] Releasing lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:51:21 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:22 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:31 user nova-compute[73208]: DEBUG nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Starting instance... {{(pid=73208) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 09:51:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:31 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:31 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73208) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 09:51:31 user nova-compute[73208]: INFO nova.compute.claims [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Claim successful on node user
Aug 16 09:51:31 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:51:31 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Start building networks asynchronously for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Allocating IP information in the background. {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] allocate_for_instance() {{(pid=73208) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 09:51:32 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 09:51:32 user nova-compute[73208]: DEBUG nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Start building block device mappings for instance. {{(pid=73208) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 09:51:32 user nova-compute[73208]: INFO nova.virt.block_device [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Booting with volume e7096d14-514e-4ab0-9b43-4ec3d8931ad3 at /dev/vda
Aug 16 09:51:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG nova.policy [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae7839fe33794c6bb9c70f3005eab84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae086cfe405c4b9f80eef45ccae6d408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73208) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG os_brick.utils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[47325730-ceaf-4310-b22b-c7d587b42a45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:eda3c1ea226b\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b9370-55bf-407b-be8a-b3f38a6c00ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6885af77-4713-496f-8695-a2eece4d28d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3835e236-6a3a-484c-bd20-2ea233212ccb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Running cmd (subprocess): nvme version {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] 'nvme version' failed. Not Retrying. {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.nvmeof [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] nvme not present on system {{(pid=73208) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 09:51:32 user nova-compute[73208]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 09:51:32 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9f5720-33b0-45d4-9e0a-d9b1aaabb067]: (4, '') {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73208) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.lightos [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] LIGHTOS: no hostnqn found. {{(pid=73208) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG os_brick.utils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:eda3c1ea226b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG nova.virt.block_device [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updating existing volume attachment record: 88c27b75-de6f-4ddf-8783-5c7d444b0bc9 {{(pid=73208) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 09:51:32 user nova-compute[73208]: DEBUG nova.network.neutron [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Successfully created port: bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 09:51:33 user nova-compute[73208]: DEBUG nova.network.neutron [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Successfully updated port: bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 09:51:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:51:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquired lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:51:33 user nova-compute[73208]: DEBUG nova.network.neutron [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Building network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 09:51:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-d84d1e99-ef41-43b3-81cc-cb90412bcdf2 req-50a037d7-7e8c-4099-b102-1e9ff5442f5c service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-changed-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:51:33 user nova-compute[73208]: DEBUG nova.compute.manager [req-d84d1e99-ef41-43b3-81cc-cb90412bcdf2 req-50a037d7-7e8c-4099-b102-1e9ff5442f5c service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Refreshing instance network info cache due to event network-changed-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:51:33 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d84d1e99-ef41-43b3-81cc-cb90412bcdf2 req-50a037d7-7e8c-4099-b102-1e9ff5442f5c service nova] Acquiring lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:51:33 user nova-compute[73208]: DEBUG nova.network.neutron [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Instance cache missing network info. {{(pid=73208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 09:51:34 user nova-compute[73208]: DEBUG nova.network.neutron [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updating instance_info_cache with network_info: [{"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:51:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Releasing lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:51:34 user nova-compute[73208]: DEBUG nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Instance network_info: |[{"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73208) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 09:51:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d84d1e99-ef41-43b3-81cc-cb90412bcdf2 req-50a037d7-7e8c-4099-b102-1e9ff5442f5c service nova] Acquired lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:51:34 user nova-compute[73208]: DEBUG nova.network.neutron [req-d84d1e99-ef41-43b3-81cc-cb90412bcdf2 req-50a037d7-7e8c-4099-b102-1e9ff5442f5c service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Refreshing network info cache for port bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:51:34 user nova-compute[73208]: DEBUG nova.network.neutron [req-d84d1e99-ef41-43b3-81cc-cb90412bcdf2 req-50a037d7-7e8c-4099-b102-1e9ff5442f5c service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updated VIF entry in instance network info cache for port bbac6174-0dd9-4ad2-93dd-6370fe09f5f8. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:51:34 user nova-compute[73208]: DEBUG nova.network.neutron [req-d84d1e99-ef41-43b3-81cc-cb90412bcdf2 req-50a037d7-7e8c-4099-b102-1e9ff5442f5c service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updating instance_info_cache with network_info: [{"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:51:34 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d84d1e99-ef41-43b3-81cc-cb90412bcdf2 req-50a037d7-7e8c-4099-b102-1e9ff5442f5c service nova] Releasing lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:51:36 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:37 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Start spawning the instance on the hypervisor. {{(pid=73208) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Creating instance directory {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 09:51:42 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Creating image(s)
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Did not create local disks {{(pid=73208) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Ensure instance console log exists: /opt/stack/data/nova/instances/bd9b9cb5-5a8d-47e2-92ec-72ac310296e5/console.log {{(pid=73208) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Start _get_guest_xml network_info=[{"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '88c27b75-de6f-4ddf-8783-5c7d444b0bc9', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVXIjtfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd9b9cb5-5a8d-47e2-92ec-72ac310296e5', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7096d14-514e-4ab0-9b43-4ec3d8931ad3', 'serial': 'e7096d14-514e-4ab0-9b43-4ec3d8931ad3'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 09:51:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:51:42 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller missing on host. {{(pid=73208) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.host [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU controller found on host. {{(pid=73208) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73208) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T09:02:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image limits 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flavor pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Image pref 0:0:0 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Got 1 possible topologies {{(pid=73208) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.hardware [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73208) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Calling os-brick to attach iSCSI Volume {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVXIjtfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:51:42 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:51:42 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:51:42 user nova-compute[73208]: INFO os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e884055-b533-4da4-be52-627e2449380e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 09:51:42 user nova-compute[73208]:  {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe76b44-8f84-40d0-ab10-aeaabeae1ef5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3] added\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3] added
Aug 16 09:51:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[80761134-6dc5-4e4c-9b21-fcb288f412b0]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a7c047-0838-4e66-bc9a-0e5069c997e2]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVXIjtfC {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVXIjtfC" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf91d7-9ba9-4255-867d-4646d8084406]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MVXIjtfC'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b05f73-576a-4550-913e-0ff61a864200]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8b89ca-112e-46ec-92f5-4f213463850a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:51:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:51:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --login {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa542a40-d228-417a-aebc-47ab50e25828]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3, portal: 172.16.0.220,3260]
Aug 16 09:51:42 user nova-compute[73208]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3, portal: 172.16.0.220,3260] successful.
Aug 16 09:51:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[18073e8b-c493-484c-93b2-a65e4e88dc02]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c8c3b0-40a4-4904-8886-dd8bbcd2e78a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:51:42 user nova-compute[73208]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 (non-flash)
Aug 16 09:51:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:51:42 user nova-compute[73208]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 (non-flash)
Aug 16 09:51:42 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to 172.16.0.220:3260 {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=73208) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73208) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[57109ed5-1b21-49de-9560-cddb1a74b982]: (4, ('- - 0', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:51:42 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73208) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVXIjtfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73208) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23134356439613939', 'path': '/dev/sdc'} {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134356439613939', 'path': '/dev/sdc'} {{(pid=73208) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1929065730',display_name='tempest-TestVolumeBootPattern-server-1929065730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1929065730',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-x8c90ssj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:51:32Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=bd9b9cb5-5a8d-47e2-92ec-72ac310296e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73208) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:13:e3,bridge_name='br-int',has_traffic_filtering=True,id=bbac6174-0dd9-4ad2-93dd-6370fe09f5f8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbac6174-0d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.objects.instance [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'pci_devices' on Instance uuid bd9b9cb5-5a8d-47e2-92ec-72ac310296e5 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 09:51:43 user nova-compute[73208]:   <uuid>bd9b9cb5-5a8d-47e2-92ec-72ac310296e5</uuid>
Aug 16 09:51:43 user nova-compute[73208]:   <name>instance-00000034</name>
Aug 16 09:51:43 user nova-compute[73208]:   <memory>524288</memory>
Aug 16 09:51:43 user nova-compute[73208]:   <vcpu>1</vcpu>
Aug 16 09:51:43 user nova-compute[73208]:   <metadata>
Aug 16 09:51:43 user nova-compute[73208]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 09:51:43 user nova-compute[73208]:       <nova:package version="0.0.0"/>
Aug 16 09:51:43 user nova-compute[73208]:       <nova:name>tempest-TestVolumeBootPattern-server-1929065730</nova:name>
Aug 16 09:51:43 user nova-compute[73208]:       <nova:creationTime>2023-08-16 09:51:42</nova:creationTime>
Aug 16 09:51:43 user nova-compute[73208]:       <nova:flavor name="m1.tiny">
Aug 16 09:51:43 user nova-compute[73208]:         <nova:memory>512</nova:memory>
Aug 16 09:51:43 user nova-compute[73208]:         <nova:disk>1</nova:disk>
Aug 16 09:51:43 user nova-compute[73208]:         <nova:swap>0</nova:swap>
Aug 16 09:51:43 user nova-compute[73208]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 09:51:43 user nova-compute[73208]:         <nova:vcpus>1</nova:vcpus>
Aug 16 09:51:43 user nova-compute[73208]:       </nova:flavor>
Aug 16 09:51:43 user nova-compute[73208]:       <nova:owner>
Aug 16 09:51:43 user nova-compute[73208]:         <nova:user uuid="ae7839fe33794c6bb9c70f3005eab84f">tempest-TestVolumeBootPattern-1567175042-project-member</nova:user>
Aug 16 09:51:43 user nova-compute[73208]:         <nova:project uuid="ae086cfe405c4b9f80eef45ccae6d408">tempest-TestVolumeBootPattern-1567175042</nova:project>
Aug 16 09:51:43 user nova-compute[73208]:       </nova:owner>
Aug 16 09:51:43 user nova-compute[73208]:       <nova:ports>
Aug 16 09:51:43 user nova-compute[73208]:         <nova:port uuid="bbac6174-0dd9-4ad2-93dd-6370fe09f5f8">
Aug 16 09:51:43 user nova-compute[73208]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 09:51:43 user nova-compute[73208]:         </nova:port>
Aug 16 09:51:43 user nova-compute[73208]:       </nova:ports>
Aug 16 09:51:43 user nova-compute[73208]:     </nova:instance>
Aug 16 09:51:43 user nova-compute[73208]:   </metadata>
Aug 16 09:51:43 user nova-compute[73208]:   <sysinfo type="smbios">
Aug 16 09:51:43 user nova-compute[73208]:     <system>
Aug 16 09:51:43 user nova-compute[73208]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 09:51:43 user nova-compute[73208]:       <entry name="product">OpenStack Nova</entry>
Aug 16 09:51:43 user nova-compute[73208]:       <entry name="version">0.0.0</entry>
Aug 16 09:51:43 user nova-compute[73208]:       <entry name="serial">bd9b9cb5-5a8d-47e2-92ec-72ac310296e5</entry>
Aug 16 09:51:43 user nova-compute[73208]:       <entry name="uuid">bd9b9cb5-5a8d-47e2-92ec-72ac310296e5</entry>
Aug 16 09:51:43 user nova-compute[73208]:       <entry name="family">Virtual Machine</entry>
Aug 16 09:51:43 user nova-compute[73208]:     </system>
Aug 16 09:51:43 user nova-compute[73208]:   </sysinfo>
Aug 16 09:51:43 user nova-compute[73208]:   <os>
Aug 16 09:51:43 user nova-compute[73208]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 09:51:43 user nova-compute[73208]:     <boot dev="hd"/>
Aug 16 09:51:43 user nova-compute[73208]:     <smbios mode="sysinfo"/>
Aug 16 09:51:43 user nova-compute[73208]:   </os>
Aug 16 09:51:43 user nova-compute[73208]:   <features>
Aug 16 09:51:43 user nova-compute[73208]:     <acpi/>
Aug 16 09:51:43 user nova-compute[73208]:     <apic/>
Aug 16 09:51:43 user nova-compute[73208]:     <vmcoreinfo/>
Aug 16 09:51:43 user nova-compute[73208]:   </features>
Aug 16 09:51:43 user nova-compute[73208]:   <clock offset="utc">
Aug 16 09:51:43 user nova-compute[73208]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 09:51:43 user nova-compute[73208]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 09:51:43 user nova-compute[73208]:     <timer name="hpet" present="no"/>
Aug 16 09:51:43 user nova-compute[73208]:   </clock>
Aug 16 09:51:43 user nova-compute[73208]:   <cpu mode="custom" match="exact">
Aug 16 09:51:43 user nova-compute[73208]:     <model>Nehalem</model>
Aug 16 09:51:43 user nova-compute[73208]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 09:51:43 user nova-compute[73208]:   </cpu>
Aug 16 09:51:43 user nova-compute[73208]:   <devices>
Aug 16 09:51:43 user nova-compute[73208]:     <disk type="block" device="disk">
Aug 16 09:51:43 user nova-compute[73208]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 09:51:43 user nova-compute[73208]:       <source dev="/dev/sdc"/>
Aug 16 09:51:43 user nova-compute[73208]:       <target dev="vda" bus="virtio"/>
Aug 16 09:51:43 user nova-compute[73208]:       <serial>e7096d14-514e-4ab0-9b43-4ec3d8931ad3</serial>
Aug 16 09:51:43 user nova-compute[73208]:     </disk>
Aug 16 09:51:43 user nova-compute[73208]:     <interface type="ethernet">
Aug 16 09:51:43 user nova-compute[73208]:       <mac address="fa:16:3e:fb:13:e3"/>
Aug 16 09:51:43 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:51:43 user nova-compute[73208]:       <mtu size="1442"/>
Aug 16 09:51:43 user nova-compute[73208]:       <target dev="tapbbac6174-0d"/>
Aug 16 09:51:43 user nova-compute[73208]:     </interface>
Aug 16 09:51:43 user nova-compute[73208]:     <serial type="pty">
Aug 16 09:51:43 user nova-compute[73208]:       <log file="/opt/stack/data/nova/instances/bd9b9cb5-5a8d-47e2-92ec-72ac310296e5/console.log" append="off"/>
Aug 16 09:51:43 user nova-compute[73208]:     </serial>
Aug 16 09:51:43 user nova-compute[73208]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 09:51:43 user nova-compute[73208]:     <video>
Aug 16 09:51:43 user nova-compute[73208]:       <model type="virtio"/>
Aug 16 09:51:43 user nova-compute[73208]:     </video>
Aug 16 09:51:43 user nova-compute[73208]:     <rng model="virtio">
Aug 16 09:51:43 user nova-compute[73208]:       <backend model="random">/dev/urandom</backend>
Aug 16 09:51:43 user nova-compute[73208]:     </rng>
Aug 16 09:51:43 user nova-compute[73208]:     <controller type="usb" index="0" model="none"/>
Aug 16 09:51:43 user nova-compute[73208]:     <memballoon model="virtio">
Aug 16 09:51:43 user nova-compute[73208]:       <stats period="10"/>
Aug 16 09:51:43 user nova-compute[73208]:     </memballoon>
Aug 16 09:51:43 user nova-compute[73208]:   </devices>
Aug 16 09:51:43 user nova-compute[73208]: </domain>
Aug 16 09:51:43 user nova-compute[73208]:  {{(pid=73208) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1929065730',display_name='tempest-TestVolumeBootPattern-server-1929065730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1929065730',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-x8c90ssj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T09:51:32Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=bd9b9cb5-5a8d-47e2-92ec-72ac310296e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:13:e3,bridge_name='br-int',has_traffic_filtering=True,id=bbac6174-0dd9-4ad2-93dd-6370fe09f5f8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbac6174-0d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG os_vif [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:13:e3,bridge_name='br-int',has_traffic_filtering=True,id=bbac6174-0dd9-4ad2-93dd-6370fe09f5f8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbac6174-0d') {{(pid=73208) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbac6174-0d, may_exist=True, interface_attrs={}) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbbac6174-0d, col_values=(('external_ids', {'iface-id': 'bbac6174-0dd9-4ad2-93dd-6370fe09f5f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:13:e3', 'vm-uuid': 'bd9b9cb5-5a8d-47e2-92ec-72ac310296e5'}),), if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:43 user nova-compute[73208]: INFO os_vif [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:13:e3,bridge_name='br-int',has_traffic_filtering=True,id=bbac6174-0dd9-4ad2-93dd-6370fe09f5f8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbac6174-0d')
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No BDM found with device name vda, not building metadata. {{(pid=73208) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 09:51:43 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] No VIF found with MAC fa:16:3e:fb:13:e3, not building metadata {{(pid=73208) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 09:51:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:44 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-db6cfccb-fa1e-4d72-8dc9-921b6d03f6ff req-53120255-facf-4a93-82c6-8cc3d6ac0078 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:51:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-db6cfccb-fa1e-4d72-8dc9-921b6d03f6ff req-53120255-facf-4a93-82c6-8cc3d6ac0078 service nova] Acquiring lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-db6cfccb-fa1e-4d72-8dc9-921b6d03f6ff req-53120255-facf-4a93-82c6-8cc3d6ac0078 service nova] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:45 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-db6cfccb-fa1e-4d72-8dc9-921b6d03f6ff req-53120255-facf-4a93-82c6-8cc3d6ac0078 service nova] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:45 user nova-compute[73208]: DEBUG nova.compute.manager [req-db6cfccb-fa1e-4d72-8dc9-921b6d03f6ff req-53120255-facf-4a93-82c6-8cc3d6ac0078 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] No waiting events found dispatching network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:51:45 user nova-compute[73208]: WARNING nova.compute.manager [req-db6cfccb-fa1e-4d72-8dc9-921b6d03f6ff req-53120255-facf-4a93-82c6-8cc3d6ac0078 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received unexpected event network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 for instance with vm_state building and task_state spawning.
Aug 16 09:51:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:46 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179507.020993, bd9b9cb5-5a8d-47e2-92ec-72ac310296e5 => Resumed> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:51:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] VM Resumed (Lifecycle Event)
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Instance event wait completed in 0 seconds for  {{(pid=73208) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Guest created on hypervisor {{(pid=73208) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 09:51:47 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Instance spawned successfully.
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Found default for hw_cdrom_bus of ide {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Found default for hw_disk_bus of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Found default for hw_input_bus of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Found default for hw_pointer_model of None {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Found default for hw_video_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Found default for hw_vif_model of virtio {{(pid=73208) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 09:51:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.virt.driver [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] Emitting event <LifecycleEvent: 1692179507.0211635, bd9b9cb5-5a8d-47e2-92ec-72ac310296e5 => Started> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:51:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] VM Started (Lifecycle Event)
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73208) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-8774ca66-9f57-4841-b08e-d84579d0f531 req-cfb49587-25a8-4b18-903a-9f5e857a3a22 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8774ca66-9f57-4841-b08e-d84579d0f531 req-cfb49587-25a8-4b18-903a-9f5e857a3a22 service nova] Acquiring lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8774ca66-9f57-4841-b08e-d84579d0f531 req-cfb49587-25a8-4b18-903a-9f5e857a3a22 service nova] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-8774ca66-9f57-4841-b08e-d84579d0f531 req-cfb49587-25a8-4b18-903a-9f5e857a3a22 service nova] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.compute.manager [req-8774ca66-9f57-4841-b08e-d84579d0f531 req-cfb49587-25a8-4b18-903a-9f5e857a3a22 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] No waiting events found dispatching network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:51:47 user nova-compute[73208]: WARNING nova.compute.manager [req-8774ca66-9f57-4841-b08e-d84579d0f531 req-cfb49587-25a8-4b18-903a-9f5e857a3a22 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received unexpected event network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 for instance with vm_state building and task_state spawning.
Aug 16 09:51:47 user nova-compute[73208]: INFO nova.compute.manager [None req-f0cc1740-42d5-4dc2-8965-35fc143341ae None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 09:51:47 user nova-compute[73208]: INFO nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 16 09:51:47 user nova-compute[73208]: DEBUG nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:51:47 user nova-compute[73208]: INFO nova.compute.manager [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Took 15.54 seconds to build instance.
Aug 16 09:51:47 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-585b3d63-ee35-471c-ae25-4c70ba828a50 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.634s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:51:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:51:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:51:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=25.205486297607422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e3d52f21-689c-4b81-9f47-a98d822b0efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 30d1dc43-1977-43b6-a3c4-a38b52d7b25c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance bd9b9cb5-5a8d-47e2-92ec-72ac310296e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:51:50 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:51:51 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:51:51 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:51 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [{"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e3d52f21-689c-4b81-9f47-a98d822b0efe" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:51:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:51:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:51:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:51:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:59 user nova-compute[73208]: INFO nova.compute.manager [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Terminating instance
Aug 16 09:51:59 user nova-compute[73208]: DEBUG nova.compute.manager [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-18d43b6c-cef5-4a76-beb2-303754415703 req-34565cc0-f85c-4c15-9dfb-aff04c919c80 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-18d43b6c-cef5-4a76-beb2-303754415703 req-34565cc0-f85c-4c15-9dfb-aff04c919c80 service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-18d43b6c-cef5-4a76-beb2-303754415703 req-34565cc0-f85c-4c15-9dfb-aff04c919c80 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-18d43b6c-cef5-4a76-beb2-303754415703 req-34565cc0-f85c-4c15-9dfb-aff04c919c80 service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-18d43b6c-cef5-4a76-beb2-303754415703 req-34565cc0-f85c-4c15-9dfb-aff04c919c80 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-18d43b6c-cef5-4a76-beb2-303754415703 req-34565cc0-f85c-4c15-9dfb-aff04c919c80 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-unplugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:51:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Instance destroyed successfully.
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.objects.instance [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'resources' on Instance uuid e3d52f21-689c-4b81-9f47-a98d822b0efe {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-268411743',display_name='tempest-ServerRescueNegativeTestJSON-server-268411743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-268411743',id=49,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAQzI8HEzk24A2xbzNXmAbNOg+HQtK1HQ1z355r6nO/ApLxwPlqbiukbUWpdEwi2gGODux3ryrZGTb/NmlaPO8o2WiJuvU6z0XcndSLjMM6AwB4tmrEWblna7vdS9dJvg==',key_name='tempest-keypair-1686473256',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-1x8vua74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=e3d52f21-689c-4b81-9f47-a98d822b0efe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "e8498fd0-804d-40cc-9ad5-3bf025666824", "address": "fa:16:3e:0c:47:f9", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8498fd0-80", "ovs_interfaceid": "e8498fd0-804d-40cc-9ad5-3bf025666824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=e8498fd0-804d-40cc-9ad5-3bf025666824,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8498fd0-80') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG os_vif [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=e8498fd0-804d-40cc-9ad5-3bf025666824,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8498fd0-80') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8498fd0-80, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:52:00 user nova-compute[73208]: INFO os_vif [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:47:f9,bridge_name='br-int',has_traffic_filtering=True,id=e8498fd0-804d-40cc-9ad5-3bf025666824,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8498fd0-80')
Aug 16 09:52:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Deleting instance files /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe_del
Aug 16 09:52:00 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Deletion of /opt/stack/data/nova/instances/e3d52f21-689c-4b81-9f47-a98d822b0efe_del complete
Aug 16 09:52:00 user nova-compute[73208]: INFO nova.compute.manager [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 09:52:00 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:52:00 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Took 0.85 seconds to deallocate network for instance.
Aug 16 09:52:00 user nova-compute[73208]: DEBUG nova.compute.manager [req-00548354-e280-402d-bd75-9adc79ff1fa3 req-6f92e03e-a7e5-48fa-8622-d755a3f789c5 service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-deleted-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:52:01 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Deleted allocations for instance e3d52f21-689c-4b81-9f47-a98d822b0efe
Aug 16 09:52:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-92121800-4c1d-41b9-b2e4-51be1b44b8e6 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.242s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-eeed1d69-dc6b-4ac9-822c-415476c70521 req-d34d47f2-4747-4b7a-986b-15a71926b95e service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-eeed1d69-dc6b-4ac9-822c-415476c70521 req-d34d47f2-4747-4b7a-986b-15a71926b95e service nova] Acquiring lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-eeed1d69-dc6b-4ac9-822c-415476c70521 req-d34d47f2-4747-4b7a-986b-15a71926b95e service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-eeed1d69-dc6b-4ac9-822c-415476c70521 req-d34d47f2-4747-4b7a-986b-15a71926b95e service nova] Lock "e3d52f21-689c-4b81-9f47-a98d822b0efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:52:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-eeed1d69-dc6b-4ac9-822c-415476c70521 req-d34d47f2-4747-4b7a-986b-15a71926b95e service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] No waiting events found dispatching network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:52:01 user nova-compute[73208]: WARNING nova.compute.manager [req-eeed1d69-dc6b-4ac9-822c-415476c70521 req-d34d47f2-4747-4b7a-986b-15a71926b95e service nova] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Received unexpected event network-vif-plugged-e8498fd0-804d-40cc-9ad5-3bf025666824 for instance with vm_state deleted and task_state None.
Aug 16 09:52:01 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:04 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:52:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:06 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:10 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:11 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:15 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179520.0092394, e3d52f21-689c-4b81-9f47-a98d822b0efe => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:52:15 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] VM Stopped (Lifecycle Event)
Aug 16 09:52:15 user nova-compute[73208]: DEBUG nova.compute.manager [None req-b843f16c-a99c-409c-872c-cbc710373ef7 None None] [instance: e3d52f21-689c-4b81-9f47-a98d822b0efe] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:52:15 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:16 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:20 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:52:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:52:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:52:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:52:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:52:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:52:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:52:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:52:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:52:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:52:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:52:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:52:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:52:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:52:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:52:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:52:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:52:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:52:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:52:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:52:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8470MB free_disk=25.232730865478516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 9dd3d75b-db07-4907-854c-42278f817bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 30d1dc43-1977-43b6-a3c4-a38b52d7b25c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance bd9b9cb5-5a8d-47e2-92ec-72ac310296e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:52:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:52:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:52:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updating instance_info_cache with network_info: [{"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:52:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:52:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:52:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:52:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:52:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:52:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:52:59 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:00 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:53:01 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:53:04 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:05 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:05 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9dd3d75b-db07-4907-854c-42278f817bb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:08 user nova-compute[73208]: INFO nova.compute.manager [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Terminating instance
Aug 16 09:53:08 user nova-compute[73208]: DEBUG nova.compute.manager [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee789b7b-ab80-40a3-9fe8-a78f054ba066 req-9bef1ad3-39fd-4d19-a685-0123e294064b service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-unplugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee789b7b-ab80-40a3-9fe8-a78f054ba066 req-9bef1ad3-39fd-4d19-a685-0123e294064b service nova] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee789b7b-ab80-40a3-9fe8-a78f054ba066 req-9bef1ad3-39fd-4d19-a685-0123e294064b service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-ee789b7b-ab80-40a3-9fe8-a78f054ba066 req-9bef1ad3-39fd-4d19-a685-0123e294064b service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee789b7b-ab80-40a3-9fe8-a78f054ba066 req-9bef1ad3-39fd-4d19-a685-0123e294064b service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] No waiting events found dispatching network-vif-unplugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG nova.compute.manager [req-ee789b7b-ab80-40a3-9fe8-a78f054ba066 req-9bef1ad3-39fd-4d19-a685-0123e294064b service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-unplugged-be56fa8f-019f-4784-8ac5-52519e145898 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Instance destroyed successfully.
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.objects.instance [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'resources' on Instance uuid 9dd3d75b-db07-4907-854c-42278f817bb9 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-316213984',display_name='tempest-ServerRescueNegativeTestJSON-server-316213984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-316213984',id=44,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-9dwyltan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:38:43Z,user_data=None,user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=9dd3d75b-db07-4907-854c-42278f817bb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "be56fa8f-019f-4784-8ac5-52519e145898", "address": "fa:16:3e:dc:6f:98", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe56fa8f-01", "ovs_interfaceid": "be56fa8f-019f-4784-8ac5-52519e145898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6f:98,bridge_name='br-int',has_traffic_filtering=True,id=be56fa8f-019f-4784-8ac5-52519e145898,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe56fa8f-01') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG os_vif [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6f:98,bridge_name='br-int',has_traffic_filtering=True,id=be56fa8f-019f-4784-8ac5-52519e145898,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe56fa8f-01') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe56fa8f-01, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:53:09 user nova-compute[73208]: INFO os_vif [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6f:98,bridge_name='br-int',has_traffic_filtering=True,id=be56fa8f-019f-4784-8ac5-52519e145898,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe56fa8f-01')
Aug 16 09:53:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Deleting instance files /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9_del
Aug 16 09:53:09 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Deletion of /opt/stack/data/nova/instances/9dd3d75b-db07-4907-854c-42278f817bb9_del complete
Aug 16 09:53:09 user nova-compute[73208]: INFO nova.compute.manager [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 09:53:09 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:53:09 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Took 0.54 seconds to deallocate network for instance.
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-00689426-8cee-465a-8342-435b771cb526 req-4c3b3652-d9c8-4b07-87e4-87212f97e311 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-deleted-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:09 user nova-compute[73208]: INFO nova.compute.manager [req-00689426-8cee-465a-8342-435b771cb526 req-4c3b3652-d9c8-4b07-87e4-87212f97e311 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Neutron deleted interface be56fa8f-019f-4784-8ac5-52519e145898; detaching it from the instance and deleting it from the info cache
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.network.neutron [req-00689426-8cee-465a-8342-435b771cb526 req-4c3b3652-d9c8-4b07-87e4-87212f97e311 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG nova.compute.manager [req-00689426-8cee-465a-8342-435b771cb526 req-4c3b3652-d9c8-4b07-87e4-87212f97e311 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Detach interface failed, port_id=be56fa8f-019f-4784-8ac5-52519e145898, reason: Instance 9dd3d75b-db07-4907-854c-42278f817bb9 could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:09 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:10 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:53:10 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:53:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:10 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Deleted allocations for instance 9dd3d75b-db07-4907-854c-42278f817bb9
Aug 16 09:53:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-0142d187-a141-4228-8f94-951441c97a29 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "9dd3d75b-db07-4907-854c-42278f817bb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.823s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-f134f19f-adfa-4e53-8adb-162e65297240 req-c5055b3a-64e1-4a38-b608-b895bef54bf7 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f134f19f-adfa-4e53-8adb-162e65297240 req-c5055b3a-64e1-4a38-b608-b895bef54bf7 service nova] Acquiring lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f134f19f-adfa-4e53-8adb-162e65297240 req-c5055b3a-64e1-4a38-b608-b895bef54bf7 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:10 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f134f19f-adfa-4e53-8adb-162e65297240 req-c5055b3a-64e1-4a38-b608-b895bef54bf7 service nova] Lock "9dd3d75b-db07-4907-854c-42278f817bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:10 user nova-compute[73208]: DEBUG nova.compute.manager [req-f134f19f-adfa-4e53-8adb-162e65297240 req-c5055b3a-64e1-4a38-b608-b895bef54bf7 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] No waiting events found dispatching network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:53:10 user nova-compute[73208]: WARNING nova.compute.manager [req-f134f19f-adfa-4e53-8adb-162e65297240 req-c5055b3a-64e1-4a38-b608-b895bef54bf7 service nova] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Received unexpected event network-vif-plugged-be56fa8f-019f-4784-8ac5-52519e145898 for instance with vm_state deleted and task_state None.
Aug 16 09:53:12 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:53:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:53:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:53:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:53:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_power_states {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid 30d1dc43-1977-43b6-a3c4-a38b52d7b25c {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Triggering sync for uuid bd9b9cb5-5a8d-47e2-92ec-72ac310296e5 {{(pid=73208) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances with incomplete migration  {{(pid=73208) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-2306ea78-5612-4108-8dd3-8767e4ad1203 req-12521d69-01ba-452e-9a17-4f26ed2383b7 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-changed-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG nova.compute.manager [req-2306ea78-5612-4108-8dd3-8767e4ad1203 req-12521d69-01ba-452e-9a17-4f26ed2383b7 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Refreshing instance network info cache due to event network-changed-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2306ea78-5612-4108-8dd3-8767e4ad1203 req-12521d69-01ba-452e-9a17-4f26ed2383b7 service nova] Acquiring lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2306ea78-5612-4108-8dd3-8767e4ad1203 req-12521d69-01ba-452e-9a17-4f26ed2383b7 service nova] Acquired lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:53:23 user nova-compute[73208]: DEBUG nova.network.neutron [req-2306ea78-5612-4108-8dd3-8767e4ad1203 req-12521d69-01ba-452e-9a17-4f26ed2383b7 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Refreshing network info cache for port bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179589.2572093, 9dd3d75b-db07-4907-854c-42278f817bb9 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:53:24 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] VM Stopped (Lifecycle Event)
Aug 16 09:53:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-35c1dde0-1a9f-439e-95f4-77d4a3a2298a None None] [instance: 9dd3d75b-db07-4907-854c-42278f817bb9] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG nova.network.neutron [req-2306ea78-5612-4108-8dd3-8767e4ad1203 req-12521d69-01ba-452e-9a17-4f26ed2383b7 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updated VIF entry in instance network info cache for port bbac6174-0dd9-4ad2-93dd-6370fe09f5f8. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG nova.network.neutron [req-2306ea78-5612-4108-8dd3-8767e4ad1203 req-12521d69-01ba-452e-9a17-4f26ed2383b7 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updating instance_info_cache with network_info: [{"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-2306ea78-5612-4108-8dd3-8767e4ad1203 req-12521d69-01ba-452e-9a17-4f26ed2383b7 service nova] Releasing lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:24 user nova-compute[73208]: INFO nova.compute.manager [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Terminating instance
Aug 16 09:53:24 user nova-compute[73208]: DEBUG nova.compute.manager [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-4c58b3fd-e148-4bdf-a775-ed0835ee3b68 req-c5fa32bc-55c7-42cd-8e98-1d44e7084976 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-vif-unplugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4c58b3fd-e148-4bdf-a775-ed0835ee3b68 req-c5fa32bc-55c7-42cd-8e98-1d44e7084976 service nova] Acquiring lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4c58b3fd-e148-4bdf-a775-ed0835ee3b68 req-c5fa32bc-55c7-42cd-8e98-1d44e7084976 service nova] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-4c58b3fd-e148-4bdf-a775-ed0835ee3b68 req-c5fa32bc-55c7-42cd-8e98-1d44e7084976 service nova] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-4c58b3fd-e148-4bdf-a775-ed0835ee3b68 req-c5fa32bc-55c7-42cd-8e98-1d44e7084976 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] No waiting events found dispatching network-vif-unplugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-4c58b3fd-e148-4bdf-a775-ed0835ee3b68 req-c5fa32bc-55c7-42cd-8e98-1d44e7084976 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-vif-unplugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:25 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Instance destroyed successfully.
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.objects.instance [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'resources' on Instance uuid bd9b9cb5-5a8d-47e2-92ec-72ac310296e5 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1929065730',display_name='tempest-TestVolumeBootPattern-server-1929065730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1929065730',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-x8c90ssj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:51:47Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=bd9b9cb5-5a8d-47e2-92ec-72ac310296e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:13:e3,bridge_name='br-int',has_traffic_filtering=True,id=bbac6174-0dd9-4ad2-93dd-6370fe09f5f8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbac6174-0d') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_vif [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:13:e3,bridge_name='br-int',has_traffic_filtering=True,id=bbac6174-0dd9-4ad2-93dd-6370fe09f5f8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbac6174-0d') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbac6174-0d, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:53:25 user nova-compute[73208]: INFO os_vif [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:13:e3,bridge_name='br-int',has_traffic_filtering=True,id=bbac6174-0dd9-4ad2-93dd-6370fe09f5f8,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbac6174-0d')
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVXIjtfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:53:25 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae7f342-80cc-4a05-9aba-c36a991b7d23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[083d1137-c78d-414e-8ca9-bdc2f99c45f5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:53:25 user nova-compute[73208]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 (non-flash)
Aug 16 09:53:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:53:25 user nova-compute[73208]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 (non-flash)
Aug 16 09:53:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6d0245cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3'): ({'sdc'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Removing single pathed devices sdc {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f42cf3b-e14f-4bbd-8d24-c91e59330e0e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac04876-8dd2-4252-bc3f-3be7045f83be]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flushing IO for device /dev/sdc {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f296357-094c-4e20-9684-71a105c4e642]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[d306d737-adb0-47e6-8364-b8e289b0511c]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] SCSI volumes sdc have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf6dd8b2-145d9a99f7904e34', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f6dd8b2', '/dev/disk/by-id/scsi-23134356439613939') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:53:25 user nova-compute[73208]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf6dd8b2-145d9a99f7904e34
Aug 16 09:53:25 user nova-compute[73208]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f6dd8b2
Aug 16 09:53:25 user nova-compute[73208]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23134356439613939
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7fbf5-89ce-43a4-b39e-971388ff9de8]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[7752ccc1-a4d7-4195-8c47-c280f10c69f0]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d1ac7-b276-4587-a16b-621515a22453]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3, portal: 172.16.0.220,3260]
Aug 16 09:53:25 user nova-compute[73208]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3, portal: 172.16.0.220,3260] successful.
Aug 16 09:53:25 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-f7f66f3c-6129-44fc-8979-1859acb7a68a req-b56bd363-3653-4eff-b2fd-36a4cd28f852 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-changed-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.compute.manager [req-f7f66f3c-6129-44fc-8979-1859acb7a68a req-b56bd363-3653-4eff-b2fd-36a4cd28f852 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Refreshing instance network info cache due to event network-changed-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f7f66f3c-6129-44fc-8979-1859acb7a68a req-b56bd363-3653-4eff-b2fd-36a4cd28f852 service nova] Acquiring lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f7f66f3c-6129-44fc-8979-1859acb7a68a req-b56bd363-3653-4eff-b2fd-36a4cd28f852 service nova] Acquired lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.network.neutron [req-f7f66f3c-6129-44fc-8979-1859acb7a68a req-b56bd363-3653-4eff-b2fd-36a4cd28f852 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Refreshing network info cache for port bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7096d14-514e-4ab0-9b43-4ec3d8931ad3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d708c0-8c32-4da8-97f0-875d6a6bdc35]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== disconnect_volume: return (310ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:53:25 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:53:25 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Deleting instance files /opt/stack/data/nova/instances/bd9b9cb5-5a8d-47e2-92ec-72ac310296e5_del
Aug 16 09:53:25 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Deletion of /opt/stack/data/nova/instances/bd9b9cb5-5a8d-47e2-92ec-72ac310296e5_del complete
Aug 16 09:53:26 user nova-compute[73208]: INFO nova.compute.manager [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 16 09:53:26 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:53:26 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:53:26 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:53:26 user nova-compute[73208]: DEBUG nova.network.neutron [req-f7f66f3c-6129-44fc-8979-1859acb7a68a req-b56bd363-3653-4eff-b2fd-36a4cd28f852 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updated VIF entry in instance network info cache for port bbac6174-0dd9-4ad2-93dd-6370fe09f5f8. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:53:26 user nova-compute[73208]: DEBUG nova.network.neutron [req-f7f66f3c-6129-44fc-8979-1859acb7a68a req-b56bd363-3653-4eff-b2fd-36a4cd28f852 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updating instance_info_cache with network_info: [{"id": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "address": "fa:16:3e:fb:13:e3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbac6174-0d", "ovs_interfaceid": "bbac6174-0dd9-4ad2-93dd-6370fe09f5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:53:26 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f7f66f3c-6129-44fc-8979-1859acb7a68a req-b56bd363-3653-4eff-b2fd-36a4cd28f852 service nova] Releasing lock "refresh_cache-bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:53:26 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:53:26 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Took 0.52 seconds to deallocate network for instance.
Aug 16 09:53:26 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-dff0cc2f-7685-4cfa-bddf-3dbd6bdd2c19 req-098f4acc-cdfe-4dab-a8c1-a7a4fa928af4 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dff0cc2f-7685-4cfa-bddf-3dbd6bdd2c19 req-098f4acc-cdfe-4dab-a8c1-a7a4fa928af4 service nova] Acquiring lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dff0cc2f-7685-4cfa-bddf-3dbd6bdd2c19 req-098f4acc-cdfe-4dab-a8c1-a7a4fa928af4 service nova] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-dff0cc2f-7685-4cfa-bddf-3dbd6bdd2c19 req-098f4acc-cdfe-4dab-a8c1-a7a4fa928af4 service nova] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-dff0cc2f-7685-4cfa-bddf-3dbd6bdd2c19 req-098f4acc-cdfe-4dab-a8c1-a7a4fa928af4 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] No waiting events found dispatching network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:53:27 user nova-compute[73208]: WARNING nova.compute.manager [req-dff0cc2f-7685-4cfa-bddf-3dbd6bdd2c19 req-098f4acc-cdfe-4dab-a8c1-a7a4fa928af4 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received unexpected event network-vif-plugged-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 for instance with vm_state active and task_state deleting.
Aug 16 09:53:27 user nova-compute[73208]: INFO nova.compute.manager [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Took 0.74 seconds to detach 1 volumes for instance.
Aug 16 09:53:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:53:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:27 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Deleted allocations for instance bd9b9cb5-5a8d-47e2-92ec-72ac310296e5
Aug 16 09:53:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-7ae8dc01-f6a2-410b-8643-7c575e01bb14 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "bd9b9cb5-5a8d-47e2-92ec-72ac310296e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.746s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-7a0a6982-2a1f-4be7-ac3f-d328e2a3f7e6 req-98c9e261-d9c7-4d7a-958a-c453cab7a2c6 service nova] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Received event network-vif-deleted-bbac6174-0dd9-4ad2-93dd-6370fe09f5f8 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:30 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:33 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Cleaning up deleted instances {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 09:53:33 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] There are 0 instances to clean {{(pid=73208) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 09:53:35 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:40 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179605.6316764, bd9b9cb5-5a8d-47e2-92ec-72ac310296e5 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:53:40 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] VM Stopped (Lifecycle Event)
Aug 16 09:53:40 user nova-compute[73208]: DEBUG nova.compute.manager [None req-fc23fed4-f4d1-4155-b18e-d1e8a6db87d9 None None] [instance: bd9b9cb5-5a8d-47e2-92ec-72ac310296e5] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:53:40 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:53:45 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:46 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:48 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:48 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:53:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:48 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73208) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73208) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 09:53:49 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:53:49 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=25.259735107421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Instance 30d1dc43-1977-43b6-a3c4-a38b52d7b25c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73208) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing inventories for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating ProviderTree inventory for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Updating inventory in ProviderTree for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing aggregate associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, aggregates: None {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Refreshing trait associations for resource provider d9b267f9-36ef-4957-8c92-af6cce6eb509, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI {{(pid=73208) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:53:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:50 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:53:52 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:53:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:53:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:53:53 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquired lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:53:53 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Forcefully refreshing network info cache for instance {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 09:53:53 user nova-compute[73208]: DEBUG nova.objects.instance [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lazy-loading 'info_cache' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:53:54 user nova-compute[73208]: DEBUG nova.network.neutron [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [{"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:53:54 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Releasing lock "refresh_cache-e54f2b10-5702-49c5-ab1a-da97d4a7ca05" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:53:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updated the network info_cache for instance {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 09:53:55 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:55 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:56 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:58 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:58 user nova-compute[73208]: INFO nova.compute.manager [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Terminating instance
Aug 16 09:53:58 user nova-compute[73208]: DEBUG nova.compute.manager [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:53:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-f3d63572-836f-4968-b361-2073addb16b2 req-9cc59a7d-04f2-4285-946d-bab3902b4536 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f3d63572-836f-4968-b361-2073addb16b2 req-9cc59a7d-04f2-4285-946d-bab3902b4536 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f3d63572-836f-4968-b361-2073addb16b2 req-9cc59a7d-04f2-4285-946d-bab3902b4536 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-f3d63572-836f-4968-b361-2073addb16b2 req-9cc59a7d-04f2-4285-946d-bab3902b4536 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-f3d63572-836f-4968-b361-2073addb16b2 req-9cc59a7d-04f2-4285-946d-bab3902b4536 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.compute.manager [req-f3d63572-836f-4968-b361-2073addb16b2 req-9cc59a7d-04f2-4285-946d-bab3902b4536 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-unplugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:53:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Instance destroyed successfully.
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.objects.instance [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lazy-loading 'resources' on Instance uuid e54f2b10-5702-49c5-ab1a-da97d4a7ca05 {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-176421415',display_name='tempest-ServerRescueNegativeTestJSON-server-176421415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-176421415',id=43,image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e197c75147746a282a02c61bba8ef65',ramdisk_id='',reservation_id='r-a019b11r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57e619ae-e236-4dcb-9810-c1a72d3e5cd4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153173897',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153173897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:43:28Z,user_data=None,user_id='a1fe7fe8c35c42aeaf87cf3c4d4a37d8',uuid=e54f2b10-5702-49c5-ab1a-da97d4a7ca05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converting VIF {"id": "99199c52-a1ab-4001-b10e-51d2af388626", "address": "fa:16:3e:b2:4c:a3", "network": {"id": "a9304da6-0176-4a65-9a66-f06ac576177b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116197268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e197c75147746a282a02c61bba8ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99199c52-a1", "ovs_interfaceid": "99199c52-a1ab-4001-b10e-51d2af388626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=99199c52-a1ab-4001-b10e-51d2af388626,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99199c52-a1') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG os_vif [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=99199c52-a1ab-4001-b10e-51d2af388626,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99199c52-a1') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99199c52-a1, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:53:59 user nova-compute[73208]: INFO os_vif [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=99199c52-a1ab-4001-b10e-51d2af388626,network=Network(a9304da6-0176-4a65-9a66-f06ac576177b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99199c52-a1')
Aug 16 09:53:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Deleting instance files /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05_del
Aug 16 09:53:59 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Deletion of /opt/stack/data/nova/instances/e54f2b10-5702-49c5-ab1a-da97d4a7ca05_del complete
Aug 16 09:53:59 user nova-compute[73208]: INFO nova.compute.manager [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 09:53:59 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:53:59 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:54:00 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:54:00 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Took 0.48 seconds to deallocate network for instance.
Aug 16 09:54:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:00 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:54:00 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:54:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:00 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Deleted allocations for instance e54f2b10-5702-49c5-ab1a-da97d4a7ca05
Aug 16 09:54:00 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-6947ffcf-0749-4918-917b-91a535fb37a3 tempest-ServerRescueNegativeTestJSON-1153173897 tempest-ServerRescueNegativeTestJSON-1153173897-project-member] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.684s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-5dd6b7a3-d7a4-4fee-b343-3b09b778ad4e req-2985e1b9-e29f-4ac7-85a4-9726ffa4d8e8 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:54:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5dd6b7a3-d7a4-4fee-b343-3b09b778ad4e req-2985e1b9-e29f-4ac7-85a4-9726ffa4d8e8 service nova] Acquiring lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5dd6b7a3-d7a4-4fee-b343-3b09b778ad4e req-2985e1b9-e29f-4ac7-85a4-9726ffa4d8e8 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:01 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-5dd6b7a3-d7a4-4fee-b343-3b09b778ad4e req-2985e1b9-e29f-4ac7-85a4-9726ffa4d8e8 service nova] Lock "e54f2b10-5702-49c5-ab1a-da97d4a7ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-5dd6b7a3-d7a4-4fee-b343-3b09b778ad4e req-2985e1b9-e29f-4ac7-85a4-9726ffa4d8e8 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] No waiting events found dispatching network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:54:01 user nova-compute[73208]: WARNING nova.compute.manager [req-5dd6b7a3-d7a4-4fee-b343-3b09b778ad4e req-2985e1b9-e29f-4ac7-85a4-9726ffa4d8e8 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received unexpected event network-vif-plugged-99199c52-a1ab-4001-b10e-51d2af388626 for instance with vm_state deleted and task_state None.
Aug 16 09:54:01 user nova-compute[73208]: DEBUG nova.compute.manager [req-5dd6b7a3-d7a4-4fee-b343-3b09b778ad4e req-2985e1b9-e29f-4ac7-85a4-9726ffa4d8e8 service nova] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Received event network-vif-deleted-99199c52-a1ab-4001-b10e-51d2af388626 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:54:01 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:54:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:54:04 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:07 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:54:09 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:14 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179639.6657503, e54f2b10-5702-49c5-ab1a-da97d4a7ca05 => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:54:14 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] VM Stopped (Lifecycle Event)
Aug 16 09:54:14 user nova-compute[73208]: DEBUG nova.compute.manager [None req-721ad798-eafc-4cb5-9f8b-3991ba9be87e None None] [instance: e54f2b10-5702-49c5-ab1a-da97d4a7ca05] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:54:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:54:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:54:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:54:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:54:14 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:19 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:24 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-d5bb453e-1f84-49ea-bd99-b0a8904ef160 req-096c2fec-7319-47f5-818c-e6720f860f6d service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-changed-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG nova.compute.manager [req-d5bb453e-1f84-49ea-bd99-b0a8904ef160 req-096c2fec-7319-47f5-818c-e6720f860f6d service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Refreshing instance network info cache due to event network-changed-8f204e39-2803-41a6-8040-d680eff47233. {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5bb453e-1f84-49ea-bd99-b0a8904ef160 req-096c2fec-7319-47f5-818c-e6720f860f6d service nova] Acquiring lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5bb453e-1f84-49ea-bd99-b0a8904ef160 req-096c2fec-7319-47f5-818c-e6720f860f6d service nova] Acquired lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG nova.network.neutron [req-d5bb453e-1f84-49ea-bd99-b0a8904ef160 req-096c2fec-7319-47f5-818c-e6720f860f6d service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Refreshing network info cache for port 8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:27 user nova-compute[73208]: INFO nova.compute.manager [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Terminating instance
Aug 16 09:54:27 user nova-compute[73208]: DEBUG nova.compute.manager [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Start destroying the instance on the hypervisor. {{(pid=73208) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-d5bb453e-1f84-49ea-bd99-b0a8904ef160 req-096c2fec-7319-47f5-818c-e6720f860f6d service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updated VIF entry in instance network info cache for port 8f204e39-2803-41a6-8040-d680eff47233. {{(pid=73208) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.network.neutron [req-d5bb453e-1f84-49ea-bd99-b0a8904ef160 req-096c2fec-7319-47f5-818c-e6720f860f6d service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updating instance_info_cache with network_info: [{"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-d5bb453e-1f84-49ea-bd99-b0a8904ef160 req-096c2fec-7319-47f5-818c-e6720f860f6d service nova] Releasing lock "refresh_cache-30d1dc43-1977-43b6-a3c4-a38b52d7b25c" {{(pid=73208) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-c22f6806-bb3d-46a7-b01b-9025c3cb930d req-2a829c33-fcb8-4c47-a91e-7e004a432145 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-vif-unplugged-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c22f6806-bb3d-46a7-b01b-9025c3cb930d req-2a829c33-fcb8-4c47-a91e-7e004a432145 service nova] Acquiring lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c22f6806-bb3d-46a7-b01b-9025c3cb930d req-2a829c33-fcb8-4c47-a91e-7e004a432145 service nova] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-c22f6806-bb3d-46a7-b01b-9025c3cb930d req-2a829c33-fcb8-4c47-a91e-7e004a432145 service nova] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-c22f6806-bb3d-46a7-b01b-9025c3cb930d req-2a829c33-fcb8-4c47-a91e-7e004a432145 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] No waiting events found dispatching network-vif-unplugged-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.compute.manager [req-c22f6806-bb3d-46a7-b01b-9025c3cb930d req-2a829c33-fcb8-4c47-a91e-7e004a432145 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-vif-unplugged-8f204e39-2803-41a6-8040-d680eff47233 for instance with task_state deleting. {{(pid=73208) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [-] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Instance destroyed successfully.
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.objects.instance [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lazy-loading 'resources' on Instance uuid 30d1dc43-1977-43b6-a3c4-a38b52d7b25c {{(pid=73208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.vif [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-324162672',display_name='tempest-TestVolumeBootPattern-server-324162672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-324162672',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVopMSrMqnnDfx1L/SjKLTDNqozcgLV05Iqr3W7NM5wTj4wHlXRvasLAuuMqfylG64EczCh9TiG0LmfngZzD9Hhg+Z/Szi1Je84PIXGg1b8HNFnQCP//y1KQbnNlHTTAw==',key_name='tempest-TestVolumeBootPattern-299356148',keypairs=<?>,launch_index=0,launched_at=2023-08-16T09:49:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae086cfe405c4b9f80eef45ccae6d408',ramdisk_id='',reservation_id='r-8vwmlu5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1567175042',owner_user_name='tempest-TestVolumeBootPattern-1567175042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T09:49:41Z,user_data=None,user_id='ae7839fe33794c6bb9c70f3005eab84f',uuid=30d1dc43-1977-43b6-a3c4-a38b52d7b25c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converting VIF {"id": "8f204e39-2803-41a6-8040-d680eff47233", "address": "fa:16:3e:56:fb:d3", "network": {"id": "25f6cfef-7dfc-4be4-91ee-7176dde54727", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-141614088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae086cfe405c4b9f80eef45ccae6d408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f204e39-28", "ovs_interfaceid": "8f204e39-2803-41a6-8040-d680eff47233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.network.os_vif_util [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:d3,bridge_name='br-int',has_traffic_filtering=True,id=8f204e39-2803-41a6-8040-d680eff47233,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f204e39-28') {{(pid=73208) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_vif [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:d3,bridge_name='br-int',has_traffic_filtering=True,id=8f204e39-2803-41a6-8040-d680eff47233,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f204e39-28') {{(pid=73208) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f204e39-28, bridge=br-int, if_exists=True) {{(pid=73208) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:54:28 user nova-compute[73208]: INFO os_vif [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:d3,bridge_name='br-int',has_traffic_filtering=True,id=8f204e39-2803-41a6-8040-d680eff47233,network=Network(25f6cfef-7dfc-4be4-91ee-7176dde54727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f204e39-28')
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] calling os-brick to detach iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6ff696800>, {'target_iqns': ['iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHUMSaYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 09:54:28 user nova-compute[73208]: WARNING os_brick.initiator.connectors.base [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d', 0)] {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[65670ab7-8c5f-4f29-948f-56a451c67744]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6882143d-c45d-4597-9d70-f02b8390e565]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:54:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d (non-flash)
Aug 16 09:54:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6b07bdb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d'): ({'sdb'}, set())}) {{(pid=73208) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Removing single pathed devices sdb {{(pid=73208) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d581768-5af8-4623-ae20-f90921356409]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda14efc-4782-4df2-a0ff-9c80985b7fc9]: (4, ('ok\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Flushing IO for device /dev/sdb {{(pid=73208) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ec357-ebff-4090-ba00-0de179de12a3]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73208) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f017fbb-29ad-421e-9510-16916ef5c292]: (4, ('1', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.linuxscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] SCSI volumes sdb have been removed. {{(pid=73208) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ee7537a', '/dev/disk/by-id/scsi-23763633936623062', '/dev/disk/by-id/scsi-1SCST_BIO7ee7537a-7cc96b0b650e99bb') {{(pid=84054) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3234dad-3d9b-4c78-b358-cb091ac979c7]: (4, None) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d')] {{(pid=73208) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[21615e82-3fbc-4ca3-9f65-c81cad1ee7b7]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --logout {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --logout" returned: 0 in 0.162s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a1224b-6118-4e7e-a114-9ab6f5d13f9f]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260]
Aug 16 09:54:28 user nova-compute[73208]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d, portal: 172.16.0.220,3260] successful.
Aug 16 09:54:28 user nova-compute[73208]:  stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op delete {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe049d2b-4779-4365-9ae8-b22de023b39d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84054) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b0f35e-8492-4764-8389-9ab6a7f756a4]: (4, ('', '')) {{(pid=84054) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73208) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.base [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] <== disconnect_volume: return (364ms) None {{(pid=73208) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Disconnected iSCSI Volume {{(pid=73208) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 09:54:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Deleting instance files /opt/stack/data/nova/instances/30d1dc43-1977-43b6-a3c4-a38b52d7b25c_del
Aug 16 09:54:28 user nova-compute[73208]: INFO nova.virt.libvirt.driver [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Deletion of /opt/stack/data/nova/instances/30d1dc43-1977-43b6-a3c4-a38b52d7b25c_del complete
Aug 16 09:54:28 user nova-compute[73208]: INFO nova.compute.manager [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 16 09:54:28 user nova-compute[73208]: DEBUG oslo.service.loopingcall [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73208) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.compute.manager [-] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Deallocating network for instance {{(pid=73208) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 09:54:28 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] deallocate_for_instance() {{(pid=73208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 09:54:29 user nova-compute[73208]: DEBUG nova.network.neutron [-] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:54:29 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Took 0.55 seconds to deallocate network for instance.
Aug 16 09:54:29 user nova-compute[73208]: DEBUG nova.compute.manager [req-6441333c-749f-410e-a330-842dd1fe0d26 req-e56f03a9-6f0b-4e85-8fe8-f6d23b07da2a service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-vif-deleted-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:54:29 user nova-compute[73208]: INFO nova.compute.manager [req-6441333c-749f-410e-a330-842dd1fe0d26 req-e56f03a9-6f0b-4e85-8fe8-f6d23b07da2a service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Neutron deleted interface 8f204e39-2803-41a6-8040-d680eff47233; detaching it from the instance and deleting it from the info cache
Aug 16 09:54:29 user nova-compute[73208]: DEBUG nova.network.neutron [req-6441333c-749f-410e-a330-842dd1fe0d26 req-e56f03a9-6f0b-4e85-8fe8-f6d23b07da2a service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Updating instance_info_cache with network_info: [] {{(pid=73208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 09:54:29 user nova-compute[73208]: DEBUG nova.compute.manager [req-6441333c-749f-410e-a330-842dd1fe0d26 req-e56f03a9-6f0b-4e85-8fe8-f6d23b07da2a service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Detach interface failed, port_id=8f204e39-2803-41a6-8040-d680eff47233, reason: Instance 30d1dc43-1977-43b6-a3c4-a38b52d7b25c could not be found. {{(pid=73208) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-316ed9c1-aac5-4bdc-b1b9-a7f7e0085020 req-13f8cf03-4653-4f5a-bfb3-8d2c1aafff22 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received event network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-316ed9c1-aac5-4bdc-b1b9-a7f7e0085020 req-13f8cf03-4653-4f5a-bfb3-8d2c1aafff22 service nova] Acquiring lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-316ed9c1-aac5-4bdc-b1b9-a7f7e0085020 req-13f8cf03-4653-4f5a-bfb3-8d2c1aafff22 service nova] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [req-316ed9c1-aac5-4bdc-b1b9-a7f7e0085020 req-13f8cf03-4653-4f5a-bfb3-8d2c1aafff22 service nova] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG nova.compute.manager [req-316ed9c1-aac5-4bdc-b1b9-a7f7e0085020 req-13f8cf03-4653-4f5a-bfb3-8d2c1aafff22 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] No waiting events found dispatching network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 {{(pid=73208) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 09:54:30 user nova-compute[73208]: WARNING nova.compute.manager [req-316ed9c1-aac5-4bdc-b1b9-a7f7e0085020 req-13f8cf03-4653-4f5a-bfb3-8d2c1aafff22 service nova] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Received unexpected event network-vif-plugged-8f204e39-2803-41a6-8040-d680eff47233 for instance with vm_state active and task_state deleting.
Aug 16 09:54:30 user nova-compute[73208]: INFO nova.compute.manager [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 09:54:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:54:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:30 user nova-compute[73208]: INFO nova.scheduler.client.report [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Deleted allocations for instance 30d1dc43-1977-43b6-a3c4-a38b52d7b25c
Aug 16 09:54:30 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-88db3db1-3db0-40f1-9172-803faaadcac6 tempest-TestVolumeBootPattern-1567175042 tempest-TestVolumeBootPattern-1567175042-project-member] Lock "30d1dc43-1977-43b6-a3c4-a38b52d7b25c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.841s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:43 user nova-compute[73208]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692179668.4758737, 30d1dc43-1977-43b6-a3c4-a38b52d7b25c => Stopped> {{(pid=73208) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 09:54:43 user nova-compute[73208]: INFO nova.compute.manager [-] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] VM Stopped (Lifecycle Event)
Aug 16 09:54:43 user nova-compute[73208]: DEBUG nova.compute.manager [None req-d41ae367-6adb-45e9-83eb-0bbf8a72aa55 None None] [instance: 30d1dc43-1977-43b6-a3c4-a38b52d7b25c] Checking state {{(pid=73208) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 09:54:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:54:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:54:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:54:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:54:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:48 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:54:49 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:54:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:54:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:54:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:54:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.279022216796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:54:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:54:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:54:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:54:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:54:50 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:54:50 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:54:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:54:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:54:52 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:54:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:54:53 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:54:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:54:53 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:54:56 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:54:57 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:54:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:01 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:01 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:55:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:06 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:08 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:55:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:55:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:55:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73208) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 09:55:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:55:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73208) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 09:55:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:27 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:28 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:29 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:32 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:33 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:38 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:43 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:48 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:49 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager.update_available_resource {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:55:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:55:49 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:55:49 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Auditing locally available compute resources for user (node: user) {{(pid=73208) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 09:55:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:55:50 user nova-compute[73208]: WARNING nova.virt.libvirt.driver [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 09:55:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.276073455810547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73208) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 09:55:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 09:55:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 09:55:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 09:55:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73208) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 09:55:50 user nova-compute[73208]: DEBUG nova.compute.provider_tree [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed in ProviderTree for provider: d9b267f9-36ef-4957-8c92-af6cce6eb509 {{(pid=73208) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 09:55:50 user nova-compute[73208]: DEBUG nova.scheduler.client.report [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Inventory has not changed for provider d9b267f9-36ef-4957-8c92-af6cce6eb509 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73208) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 09:55:50 user nova-compute[73208]: DEBUG nova.compute.resource_tracker [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Compute_service record updated for user:user {{(pid=73208) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 09:55:50 user nova-compute[73208]: DEBUG oslo_concurrency.lockutils [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=73208) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 09:55:51 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:53 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:55:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Starting heal instance info cache {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 09:55:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Rebuilding the list of instances to heal {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 09:55:54 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Didn't find any instances for network info cache update. {{(pid=73208) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 09:55:54 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:57 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:55:58 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:55:58 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:56:01 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:56:01 user nova-compute[73208]: DEBUG nova.compute.manager [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73208) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 09:56:03 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:56:03 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:56:08 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:56:10 user nova-compute[73208]: DEBUG oslo_service.periodic_task [None req-189f66e4-49df-475c-bbe5-a3e93965c25d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73208) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 09:56:13 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 09:56:18 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 09:56:23 user nova-compute[73208]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73208) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}